Edit

SpeechToText

  • Article

The SpeechToText API provides the ability to convert speech to text.

Screenshot of SpeechText implemented on macOS

The following preconditions required for the SpeechToText:

Add permissions to AndroidManifest.xml:

<uses-permission android:name="android.permission.RECORD_AUDIO" />

Syntax

C#

The SpeechToText can be used as follows in C#:

async Task Listen(CancellationToken cancellationToken)
{
    var isGranted = await speechToText.RequestPermissions(cancellationToken);
    if (!isGranted)
    {
        await Toast.Make("Permission not granted").Show(CancellationToken.None);
        return;
    }

    var recognitionResult = await speechToText.ListenAsync(
                                        CultureInfo.GetCultureInfo(Language),
                                        new Progress<string>(partialText =>
                                        {
                                            RecognitionText += partialText + " ";
                                        }), cancellationToken);

    if (recognitionResult.IsSuccessful)
    {
        RecognitionText = recognitionResult.Text;
    }
    else
    {
        await Toast.Make(recognitionResult.Exception?.Message ?? "Unable to recognize speech").Show(CancellationToken.None);
    }
}

or using events:

async Task StartListening(CancellationToken cancellationToken)
{
    var isGranted = await speechToText.RequestPermissions(cancellationToken);
    if (!isGranted)
    {
        await Toast.Make("Permission not granted").Show(CancellationToken.None);
        return;
    }

    speechToText.RecognitionResultUpdated += OnRecognitionTextUpdated;
    speechToText.RecognitionResultCompleted += OnRecognitionTextCompleted;
    await SpeechToText.StartListenAsync(CultureInfo.CurrentCulture, CancellationToken.None);
}

async Task StopListening(CancellationToken cancellationToken)
{
    await SpeechToText.StopListenAsync(CancellationToken.None);
    SpeechToText.Default.RecognitionResultUpdated -= OnRecognitionTextUpdated;
    SpeechToText.Default.RecognitionResultCompleted -= OnRecognitionTextCompleted;
}

void OnRecognitionTextUpdated(object? sender, SpeechToTextRecognitionResultUpdatedEventArgs args)
{
    RecognitionText += args.RecognitionResult;
};

void OnRecognitionTextCompleted(object? sender, SpeechToTextRecognitionResultCompletedEventArgs args)
{
    RecognitionText = args.RecognitionResult;
};

Methods

Method Description
RequestPermissions Asks for permission.
ListenAsync Starts speech recognition.
StartListenAsync Starts the SpeechToText service. (Real time speech recognition results will be surfaced via RecognitionResultUpdated and RecognitionResultCompleted)
StopListenAsync Stops the SpeechToText service. (Speech recognition results will be surfaced via RecognitionResultCompleted)

SpeechToTextResult

The result returned from the ListenAsync method. This can be used to verify whether the recognition was successful, and also access any exceptions that may have ocurred during the speech recognition.

Properties

Property Type Description
Text string The recognized text.
Exception Exception Gets the Exception if the speech recognition operation failed.
IsSuccessful bool Gets a value determining whether the operation was successful.
CurrentState SpeechToTextState Gets a current listening state.

Events

EventName EventArgs Description
RecognitionResultUpdated SpeechToTextRecognitionResultUpdatedEventArgs Triggers when SpeechToText has real time updates.
RecognitionResultCompleted SpeechToTextRecognitionResultCompletedEventArgs Triggers when SpeechToText has completed.
StateChanged SpeechToTextStateChangedEventArgs Triggers when CurrentState has changed.

Methods

Method Description
EnsureSuccess Verifies whether the speech to text operation was successful.

Warning

EnsureSuccess will throw an Exception if the recognition operation was unsuccessful.

Dependency Registration

In case you want to inject service, you first need to register it. Update MauiProgram.cs with the next changes:

public static class MauiProgram
{
    public static MauiApp CreateMauiApp()
    {
        var builder = MauiApp.CreateBuilder();
        builder
            .UseMauiApp<App>()
			.UseMauiCommunityToolkit();

		builder.Services.AddSingleton<ISpeechToText>(SpeechToText.Default);
        return builder.Build();
    }
}

Now you can inject the service like this:

public partial class MainPage : ContentPage
{
    private readonly ISpeechToText speechToText;

	public MainPage(ISpeechToText speechToText)
	{
		InitializeComponent();
        this.speechToText = speechToText;
	}
	
	public async void Listen(object sender, EventArgs args)
	{
		var isGranted = await speechToText.RequestPermissions(cancellationToken);
        if (!isGranted)
        {
            await Toast.Make("Permission not granted").Show(CancellationToken.None);
            return;
        }

        var recognitionResult = await speechToText.ListenAsync(
                                            CultureInfo.GetCultureInfo("uk-ua"),
                                            new Progress<string>(), cancellationToken);

        recognitionResult.EnsureSuccess();
        await Toast.Make($"RecognizedText: {recognitionResult.Text}").Show(cancellationToken);
	}
}

Examples

You can find an example of SpeechToText in action in the .NET MAUI Community Toolkit Sample Application.

API

You can find the source code for SpeechToText over on the .NET MAUI Community Toolkit GitHub repository.