Azure Whisper Diarization

Question

Azure Whisper Diarization

Devi Suseelan(UST,GB) 0

Hi Team, I was trying to use whisper diarization, but I am not getting diarization in the text. I tried using the API for this, but not working as expected. Then tried integrating the python code mentioned in this article.Real-time diarization quickstart - Speech service - Azure AI services | Microsoft Learn. But the transcription code itself doesn't seems to be working. User's image

romungi-MSFT 48,916 Reputation points Microsoft Employee Moderator

2024-02-22T08:13:08.93+00:00

@Devi Suseelan(UST,GB) I think in your case, the keys might not be set correctly. Please check this part of the script to set the keys directly instead of environment variables. speech_config = speechsdk.SpeechConfig(subscription=os.environ.get('SPEECH_KEY'), region=os.environ.get('SPEECH_REGION')) speech_config.speech_recognition_language="en-US" audio_config = speechsdk.audio.AudioConfig(filename="katiesteve.wav") Change to speech_config = speechsdk.SpeechConfig(subscription="SPEECH_KEY", region="SPEECH_REGION") speech_config.speech_recognition_language="en-US" audio_config = speechsdk.audio.AudioConfig(filename="katiesteve.wav") Also, the speech whisper model is only available through REST API for batch scenarios. The above quickstart can be used for short audio using the speech models that are already available with the speech service. Thanks!!
romungi-MSFT 48,916 Reputation points Microsoft Employee Moderator

2024-02-27T10:48:16.1766667+00:00

@Devi Suseelan(UST,GB) Did the suggestions provided help to fix your issue? Thanks!!

1 answer

Your answer

romungi-MSFT 48,916 Reputation points Microsoft Employee Moderator

2024-02-22T08:13:08.93+00:00

@Devi Suseelan(UST,GB) I think in your case, the keys might not be set correctly. Please check this part of the script to set the keys directly instead of environment variables. speech_config = speechsdk.SpeechConfig(subscription=os.environ.get('SPEECH_KEY'), region=os.environ.get('SPEECH_REGION')) speech_config.speech_recognition_language="en-US" audio_config = speechsdk.audio.AudioConfig(filename="katiesteve.wav") Change to speech_config = speechsdk.SpeechConfig(subscription="SPEECH_KEY", region="SPEECH_REGION") speech_config.speech_recognition_language="en-US" audio_config = speechsdk.audio.AudioConfig(filename="katiesteve.wav") Also, the speech whisper model is only available through REST API for batch scenarios. The above quickstart can be used for short audio using the speech models that are already available with the speech service. Thanks!!
romungi-MSFT 48,916 Reputation points Microsoft Employee Moderator

2024-02-27T10:48:16.1766667+00:00

@Devi Suseelan(UST,GB) Did the suggestions provided help to fix your issue? Thanks!!

Answer 1

Hello @Devi Suseelan(UST,GB)

Welcome to Microsoft QnA!

I can see you are having an issue distinguishing speakers in your speech to text

Kindly let us knowif you tried with an Audio File of yours

If yes make sure the file is WAV formated , and try again with smaller file size

Also are you setting the KEy correctly ?

To set the SPEECH_KEY environment variable, replace your-key with one of the keys for your resource.
To set the SPEECH_REGION environment variable, replace your-region with one of the regions for your resource.

Make sure that you set the SPEECH_KEY and SPEECH_REGION environment variables. If you don't set these variables, the sample fails with an error message.

I hope this helps!

Kindly mark the answer as Accepted and Upvote in case it helped! Regards

Share via

Azure Whisper Diarization

1 answer

Your answer