TTS is not working in IOS

Question

TTS is not working in IOS

Sumit Goyal 0

We have been using Azure TTS for our webapp . But the TTS is not being supported on IOS while it works well on android.

Also the Latency of TTS on android is very high .

Saideep Anchuri 9,500 Reputation points Moderator

2024-10-23T20:26:22.4133333+00:00
Hi Sumit Goyal

Welcome to Microsoft Q&A Forum, thank you for posting your query here!

I understand that you are encountering an issue TTS is not working on iOS, and on Android, you're seeing high latency.

Kindly go through the below troubleshooting steps for IOS issue:

Ensure that you have correctly configured azure TTS webapp.

Make sure you are using the correct azure TTS Api endpoint and version.

Ensure that your webapp is compatible with IOS browser you are using to test Azure TTS.

Below are some potential steps for high latency on android:

Make sure your network connection is stable and fast enough, to support low latency.

Thank You.
Saideep Anchuri 9,500 Reputation points Moderator

2024-10-24T14:43:58.5133333+00:00

Hi Sumit Goyal

Following up to see if the given response was helpful.

Thank You.
Saideep Anchuri 9,500 Reputation points Moderator

2024-10-25T14:33:12.7+00:00

Hi Sumit Goyal

We haven’t heard from you on the last response and was just checking back to see if the give response was helpful.

Thank You.

Sumit Goyal 0

@Anonymous everything is correctly setup it's just that iOS is not playing any stream chunk after the first chunk.

If you have any implementation example of iOS webapp please share that .

Here is my code that is causing issue .

const reader: any = await generateSpeechNew(currentAssistant?.welcome_message, currentCall, new_signal);

processAudioChunk(reader);

const processAudioChunk = (reader: any) => {

let audio_chunk: any = [];

let played = false;

reader?.read().then(function processStream({ done, value }: any) {

  if (intruptRef.current) {

    return;

  }

  if (value) {

    audio_chunk.push(value);

  }

  const totalLength = audio_chunk.reduce((acc: number, chunk: any) => acc + chunk.length, 0);

  if (totalLength > 8000 || done) {

    const mergedChunk = new Uint8Array(totalLength);

    let offset = 0;

    for (const chunk of audio_chunk) {

      mergedChunk.set(chunk, offset);

      offset += chunk.length;

    }

    audioBufferQueue.current.push(mergedChunk.buffer);

    if (!played) {

      played = true;

      playNextBuffer();

    }

    audio_chunk = [];

  }

  if (done) return;

  reader.read().then(processStream);

});

};

const playNextBuffer = async () => {

if (intruptRef.current) {

  audioBufferQueue.current = [];

  intruptRef.current = false;

  return;

}

if (audioBufferQueue.current.length > 0 && !audiocontaxtRef.current.currentlyPlaying) {

  const buffer = await audiocontaxtRef.current.decodeAudioData(audioBufferQueue.current.shift());

  const source = audiocontaxtRef.current.createBufferSource();

  source.buffer = buffer;

  source.connect(audiocontaxtRef.current.destination);

  source.start();

  source.onended = () => {

    playNextBuffer();

  };

}

};

Saideep Anchuri 9,500 Reputation points Moderator

2024-10-29T17:50:52.35+00:00
Hi Sumit Goyal

I recommend reporting this issue to the Azure support team. They will be able to investigate the issue further and provide a more targeted solution. You can report the issue by following these steps:

Go to the Azure portal and navigate to your OpenAI Service resource.

Click on the "Support + troubleshooting" tab.

Fill out the required information, including a detailed description of the issue and any steps you have taken to troubleshoot it.

Submit the support request.

The Azure support team will review your request and provide assistance as soon as possible Azure support.

Thank You.

Your answer

Saideep Anchuri 9,500 Reputation points Moderator

2024-10-23T20:26:22.4133333+00:00

Hi Sumit Goyal

Welcome to Microsoft Q&A Forum, thank you for posting your query here!

I understand that you are encountering an issue TTS is not working on iOS, and on Android, you're seeing high latency.

Kindly go through the below troubleshooting steps for IOS issue:

Ensure that you have correctly configured azure TTS webapp.

Make sure you are using the correct azure TTS Api endpoint and version.

Ensure that your webapp is compatible with IOS browser you are using to test Azure TTS.

Below are some potential steps for high latency on android:

Make sure your network connection is stable and fast enough, to support low latency.

Thank You.
Saideep Anchuri 9,500 Reputation points Moderator

2024-10-24T14:43:58.5133333+00:00

Hi Sumit Goyal

Following up to see if the given response was helpful.

Thank You.
Saideep Anchuri 9,500 Reputation points Moderator

2024-10-25T14:33:12.7+00:00

Hi Sumit Goyal

We haven’t heard from you on the last response and was just checking back to see if the give response was helpful.

Thank You.
Sumit Goyal 0 Reputation points

2024-10-27T20:24:47.08+00:00

@Anonymous everything is correctly setup it's just that iOS is not playing any stream chunk after the first chunk.

If you have any implementation example of iOS webapp please share that .

Here is my code that is causing issue .

const reader: any = await generateSpeechNew(currentAssistant?.welcome_message, currentCall, new_signal);

processAudioChunk(reader);

const processAudioChunk = (reader: any) => {

let audio_chunk: any = []; let played = false; reader?.read().then(function processStream({ done, value }: any) { if (intruptRef.current) { return; } if (value) { audio_chunk.push(value); } const totalLength = audio_chunk.reduce((acc: number, chunk: any) => acc + chunk.length, 0); if (totalLength > 8000 || done) { const mergedChunk = new Uint8Array(totalLength); let offset = 0; for (const chunk of audio_chunk) { mergedChunk.set(chunk, offset); offset += chunk.length; } audioBufferQueue.current.push(mergedChunk.buffer); if (!played) { played = true; playNextBuffer(); } audio_chunk = []; } if (done) return; reader.read().then(processStream); });

};

const playNextBuffer = async () => {

if (intruptRef.current) { audioBufferQueue.current = []; intruptRef.current = false; return; } if (audioBufferQueue.current.length > 0 && !audiocontaxtRef.current.currentlyPlaying) { const buffer = await audiocontaxtRef.current.decodeAudioData(audioBufferQueue.current.shift()); const source = audiocontaxtRef.current.createBufferSource(); source.buffer = buffer; source.connect(audiocontaxtRef.current.destination); source.start(); source.onended = () => { playNextBuffer(); }; }

};
Saideep Anchuri 9,500 Reputation points Moderator

2024-10-29T17:50:52.35+00:00

Hi Sumit Goyal

I recommend reporting this issue to the Azure support team. They will be able to investigate the issue further and provide a more targeted solution. You can report the issue by following these steps:

Go to the Azure portal and navigate to your OpenAI Service resource.

Click on the "Support + troubleshooting" tab.

Fill out the required information, including a detailed description of the issue and any steps you have taken to troubleshoot it.

Submit the support request.

The Azure support team will review your request and provide assistance as soon as possible Azure support.

Thank You.

Share via

TTS is not working in IOS

Your answer