Pronunciation assessment

Yagit 20 Reputation points
2023-12-30T07:03:41.77+00:00

Hello team, I want to use OpenAI to develop an app to help students to do pronunciation assessment. But I don’t find any clue. How to do it?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,111 questions
{count} votes

Accepted answer
  1. YutongTie-MSFT 53,976 Reputation points Moderator
    2023-12-30T23:40:10.3533333+00:00

    @Yagit

    Thanks for reaching out to us, if you are willing to develop an app to do so, I would suggest you try Pronunciation assessment feature which is just for this scenario. And you don't need to develop an app.

    Fortunately, you can do it directly in Speech Studio if you have the recording.

    Screenshot of showing assessment result on Display window which includes transcript and feedback on your speech.

    Reading and speaking scenarios

    For pronunciation assessment, there are two scenarios: Reading and Speaking.

    • Reading: This scenario is designed for scripted assessment. It requires the learner to read a given text. The reference text is provided in advance.
    • Speaking: This scenario is designed for unscripted assessment. It requires the learner to speak on a given topic. The reference text is not provided in advance.

    Please take a look on above information and let me know if that is your case. If you want to develop your, you may want to consider custom speech feature which you can leverage it to do the scenario, you will know how to evaluate pronunciation with speech to text through the Speech SDK. To get pronunciation assessment results, you apply the PronunciationAssessmentConfig settings to a SpeechRecognizer object according to below document -

    https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-pronunciation-assessment?pivots=programming-language-csharp

    I hope this helps.

    Regards,

    Yutong

    1 person found this answer helpful.

1 additional answer

Sort by: Most helpful
  1. Vahid Ghafarpour 23,385 Reputation points Volunteer Moderator
    2023-12-30T20:50:26.7033333+00:00

    Thanks for posting your question in the Microsoft Q&A forum.
    OpenAI is an excellent platform for developing teaching apps:

    https://openai.com/blog/teaching-with-ai

    Also, Azure AI Speech provides features that can be used to help language learners.

    https://learn.microsoft.com/en-us/azure/ai-services/speech-service/language-learning-overview

    I hope these articles can help you to start your path.

    ** Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful **

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.