How to Create web application using custom voice commands with Azure services

Question

How to Create web application using custom voice commands with Azure services

Ashish D 20

Hi,

i want to create the voice command based web application?

in that application i want to perform operations through voice

for ex suppose there is a form and form contains multiple fields like First name, Last Name, Date of Birth, Mobile number.

now if user pass the voice command as First name -Akash then the first name textbox gets filled automatically like if user says Mobile no -9876543XXX then mobile no textbox gets filled.

Thanks in advance :)

Azar 29,520 Reputation points MVP Volunteer Moderator

2023-07-14T15:02:29.0466667+00:00
Hi Anish , These are a few step for achieving the criteria you mentioned,

Set up an Azure Speech to Text resource:

Create an Azure account if you don't have one already.

Navigate to the Azure portal (portal.azure.com) and create a new Speech to Text resource.

Retrieve the necessary credentials (subscription key and region) to access the service.

Create a Web Application:

Develop a web application using HTML, CSS, and JavaScript. You can use frameworks like React or Angular, or a simple HTML page with JavaScript.

Ensure that your web application is hosted on a server and accessible via a URL.

Integrate Azure Speech to Text:

Add the necessary JavaScript libraries to your web application to interact with the Azure Speech to Text service.

Use the Azure Speech to Text SDK or REST API to send audio recordings of voice commands to the Azure service for conversion to text.

Retrieve the transcribed text from the Azure Speech to Text service.

Define Voice Commands and Actions:

Determine the voice commands you want to support and the corresponding actions.

Create a mapping between voice commands and form fields/actions in your application.

For example, map the voice command "First name - [value]" to the action of filling the first name field with the extracted value.

Capture Voice Input and Extract Relevant Information:

Set up event listeners to capture the user's voice input using the browser's Web Speech API.

Send the captured audio recording to the Azure Speech to Text service for transcription.

Extract the relevant information from the transcribed text based on your defined voice commands.

Modify the Form Fields:

Access the appropriate form fields using JavaScript.

Update the values of the form fields based on the extracted information from the voice command.

Validate and Submit the Form:

Implement form validation to ensure the user has entered all the required information correctly.

Once the form is valid, you can submit it to the server for further processing.

If you find this answer useful kindly accept it, for any assistance kindly ping in comments hanks.

1 answer

Your answer

Answer 1

VasaviLankipalle-MSFT 18,676 Moderator

Hello @Ashish D ,Thanks for using Microsoft Q&A Platform.

Did you get a chance to check these custom commands feature in Speech Studio: https://learn.microsoft.com/en-us/azure/cognitive-services/speech-service/custom-commands

Is this something you are looking help for?

Regards,
Vasavi

-Please kindly accept the answer and vote 'yes' if you feel helpful to support the community, thanks.

Share via

How to Create web application using custom voice commands with Azure services

1 answer

Your answer