Speech Functionality in Azure AI Foundry Prompt Flow

Question

Hi, I have question regarding Azure AI Foundry prompt flow. Currently, I want to create a conversational chatbot mobile application that can receive 2 inputs from user. One input is from text input and another one is speech-to-text input. Currently, I am using Multi Round Q&A on Your Data template prompt flow in Azure AI Foundry. May I know, how I want to include the speech-to text functionality? Because I could not see any speech recommendation in input section. I am using React Native by the way to implement this chatbot for my own application. Kindly assist. Thank you.

Answer 1

@Farah Diana Masri Welcome to Microsoft Q&A Forum, Thank you for posting your query here!
.

Please note that, the Azure AI Foundry’s Prompt Flow doesn’t currently offer native speech input options directly within the prompt flow interface. Considering some of the features within the prompt flow are still under preview, there could be more functionalities added in the future roadmap.

So for up-to-date information and any future updates, you can refer: https://learn.microsoft.com/en-us/azure/ai-studio/how-to/flow-develop

This documentation doesn't talk about anything speech input support as of today.

.

.

As a workaround, you'll need to handle this part separately using other Azure services like Azure Speech Services (for speech-to-text). You can have a custom solution using ReactJS application to perform the Speech to Text:

https://github.com/Azure-Samples/AzureSpeechReactSample

.

Then you can use that text as input to your promptflow.

.

Hope this helps.