Integrate Avaya IP Office with Azure Speech real-time STT

davide445 0

A customer is using Avaya IP Office IP system to manage some hundreds of daily calls.

Our goal is to integrate with Azure Speech to transcribe the calls and next manage them trough a bot service.

It's unclear how Avaya is supposed to forward a call to the Azure service. They can forward a call to an IP adress, but in the Azure Speech documentation is written to setup an integration using the SDK i.e. in Python

https://learn.microsoft.com/en-us/azure/ai-services/speech-service/get-started-speech-to-text?tabs=linux%2Cterminal&pivots=programming-language-python

The example show how to get the audio from a microphone, but what about if the audio is coming from a device such as the Avaya?

Seems IP Office has many different interfaces

https://www.devconnectprogram.com/site/global/products_resources/ip_office/interfaces/index.gsp

santoshkc 7,845 Reputation points Microsoft Vendor

2024-03-06T11:56:33.99+00:00

Hi @davide445,

Thank you for reaching out to Microsoft Q&A forum!

To integrate Avaya IP Office IP system with Azure Speech, you can use the Avaya IP Office TAPI interface to capture the audio stream from the call and then use the Azure Speech SDK to transcribe the audio to text.

To get audio from a device such as the Avaya IP Office IP system, you can use call recording software that can capture audio from the device. Many call recording software solutions are available in the market that can integrate with the Avaya IP Office system and capture audio from the device during a call. Once the audio is captured, you can process it using a speech-to-text service.

You can pass the transcribed text to a bot service for further processing. You can use the Azure Bot Service to create a bot that can receive the transcribed text and perform actions based on the content of the text.

I hope you understand! Thank you.
davide445 0 Reputation points

2024-03-06T12:23:10.1766667+00:00

Hi @santoshkc f

Thanks for your suggestions.

Looking at the doc and before speaking again with the Avaya specialist, want to clarify a bit more some topics if you can

IP Office TAPI seems to be a Windows only interface and I'm not sure this is the case due as far I understand is possible to install different OS on.

There is the possibility to use directly in IP office a standard python script and so using all the Azure Speech SDK needed modules?

Regarding getting the audio, the goal is answer in realtime, so not doing batch STT but realtime. So we will need to get out an audio stream and not an audio recording. Will be this possible?

And what form of audio stream will be acceptable for Azure Speech realtime STT service?
santoshkc 7,845 Reputation points Microsoft Vendor

2024-03-07T08:54:07.3866667+00:00
Hi @davide445,

Thank you for you follow-up questions.

IP Office TAPI is a Microsoft interface that enables Windows machines to apply first- and third-party call control.

You can use the Azure Speech SDK in a Python script to perform real-time speech-to-text (STT) on audio streams.

To get the audio stream, you can use the PyAudio library in Python to capture audio from a microphone or other audio input device.

Regarding the format of the audio stream, the Azure Speech SDK supports several audio formats, including WAV, MP3, and FLAC.

I hope this helps. Thank you.

Share via

Integrate Avaya IP Office with Azure Speech real-time STT

Your answer