audio tag in ssml is not working

Mounica T 20 Microsoft Employee

<speak xmlns="http://www.w3.org/2001/10/synthesis" xmlns:mstts="http://www.w3.org/2001/mstts" xmlns:emo="http://www.w3.org/2009/10/emotionml" version="1.0" xml:lang="en-US"> <voice name="en-US-AvaMultilingualNeural"> <audio src="https://storageacmounica.blob.core.windows.net/files/BabyElephantWalk60.wav"/> Hello </voice> </speak>

Audio is not being played. Made sure my resource had Storage Blob Data Reader role attached, it shouldnt be that its not able to access the blob

SriLakshmi C (Quadrant Resource LLC) 175 Reputation points Microsoft Vendor

2024-09-17T14:13:10.4566667+00:00

Hello Mounica T,

We are reaching out to the internal team to get more information related to your query and will get back to you as soon as we have an update.
SriLakshmi C (Quadrant Resource LLC) 175 Reputation points Microsoft Vendor

2024-09-18T01:22:07.7666667+00:00
Hello Mounica T, Greetings!

It seems that the <audio> tag in SSML might not be functioning as expected, even though your Azure Blob Storage has the necessary permissions with the Storage Blob Data Reader role. While the SSML you've provided is correctly structured, there are a few potential reasons why the audio isn't playing. One possibility is that the Azure Text-to-Speech (TTS) service supports only certain audio formats, like .mp3 or .wav files with PCM encoding, and if your file isn't in the correct format, it may not play. Additionally, cross-origin resource sharing (CORS) issues might prevent the service from accessing the file, even if it is publicly accessible.

I recommend checking the format of your audio file and ensuring that it's accessible publicly. If needed, you can adjust the CORS settings in your Blob Storage to allow access. While the use of external audio via the <audio> tag might not be fully supported by Azure TTS, I was able to successfully execute the SSML file in my Command Prompt using the provided curl command.

Here is the command that generates the audio file using the Azure TTS API and then uploads it to Azure Blob Storage using below cmd:

curl --location --request POST "https://<YOUR_REGION>.tts.speech.microsoft.com/cognitiveservices/v1" --header "Ocp-Apim-Subscription-Key: YOUR_SUBSCRIPTION_KEY" --header "Content-Type: application/ssml+xml" --header "X-Microsoft-OutputFormat: audio-16khz-128kbitrate-mono-mp3" --header "User-Agent: curl" --data-raw "<speak version='1.0' xmlns='http://www.w3.org/2001/10/synthesis' xml:lang='en-US'><voice name='en-US-AvaMultilingualNeural'>This is a simple test for text-to-speech.</voice></speak>" > output_tts.mp3 && az storage blob upload --account-name YOUR_STORAGE_ACCOUNT --container-name YOUR_CONTAINER_NAME --name output_tts.mp3 --file output_tts.mp3 --account-key YOUR_ACCOUNT_KEY

See below screen shot of the repro:

Do let me know if that helps or have any other queries. Thank you!
SriLakshmi C (Quadrant Resource LLC) 175 Reputation points Microsoft Vendor

2024-09-19T08:56:37.4566667+00:00

Hi Mounica T,

Following up to see if the above response was helpful. Thank you!
SriLakshmi C (Quadrant Resource LLC) 175 Reputation points Microsoft Vendor

2024-09-20T07:36:43.0633333+00:00

Hello Mounica T,

Just checking into see if the above response was helpful. Thank you!

Share via

audio tag in ssml is not working

Your answer