How to send a byte array to Azure Speech Service (Speech to Text)

Question

How to send a byte array to Azure Speech Service (Speech to Text)

Arvig, Kris 0

We would like to use Azure Speech Service (Speech to Text) for our project.

I have tried all the examples on this page:

https://learn.microsoft.com/en-us/azure/cognitive-services/speech-service/how-to-recognize-speech?pivots=programming-language-csharp

I can get all the examples to work... except for the Stream example... and that's the one I need.

I need the Stream example to work, because on our site we will have users upload a WAV file, so it will be in a Stream format. A Byte Array would be even better than a Stream.

Here's my thread detailing everything I've tried:

https://stackoverflow.com/questions/76095737/how-to-send-a-byte-array-to-azure-speech-service-speech-to-text

Can someone please tell me how to get the Stream example to work?
And also can you give me an example of how to send a Byte Array?

It's not the file I'm testing with that is the problem, because I was able to get the other examples on that page to work.

Thanks

YutongTie-MSFT 39,611

Hello @Arvig, Kris Could you please share the error message when you tried below stream sample in the document to us?

using System;
using System.IO;
using System.Threading.Tasks;
using Microsoft.CognitiveServices.Speech;
using Microsoft.CognitiveServices.Speech.Audio;

class Program 
{
    async static Task FromStream(SpeechConfig speechConfig)
    {
        var reader = new BinaryReader(File.OpenRead("PathToFile.wav"));
        using var audioConfigStream = AudioInputStream.CreatePushStream();
        using var audioConfig = AudioConfig.FromStreamInput(audioConfigStream);
        using var speechRecognizer = new SpeechRecognizer(speechConfig, audioConfig);

        byte[] readBytes;
        do
        {
            readBytes = reader.ReadBytes(1024);
            audioConfigStream.Write(readBytes, readBytes.Length);
        } while (readBytes.Length > 0);

        var result = await speechRecognizer.RecognizeOnceAsync();
        Console.WriteLine($"RECOGNIZED: Text={result.Text}");
    }

    async static Task Main(string[] args)
    {
        var speechConfig = SpeechConfig.FromSubscription("YourSpeechKey", "YourSpeechRegion");
        await FromStream(speechConfig);
    }
}

Thanks a lot.

Arvig, Kris 0 Reputation points

2023-04-27T15:46:01.84+00:00

I just re-read your post... Let me try that code and update this

Arvig, Kris 0

Ok this is the result I got:

RECOGNIZED: Text=

ResultId:7f453e588631461abf50258a71ee33d6 Reason:NoMatch Recognized text:<>. Json:{"Id":"7f453e588631461abf50258a71ee33d6","RecognitionStatus":"InitialSilenceTimeout","Offset":0,"Duration":106200000,"Channel":0}

This is the code I copied from your post, and then I put my variables in there:

 public static string _speechFileDir = @"C:\TestSpeechFiles\";
    public static string _filePath = _speechFileDir + "oh-yeah-everything-is-fine.wav";

    async static Task FromStream(SpeechConfig speechConfig)
    {
        var reader = new BinaryReader(File.OpenRead(_filePath));
        using var audioConfigStream = AudioInputStream.CreatePushStream();
        using var audioConfig = AudioConfig.FromStreamInput(audioConfigStream);
        using var speechRecognizer = new SpeechRecognizer(speechConfig, audioConfig);

        byte[] readBytes;
        do
        {
            readBytes = reader.ReadBytes(1024);
            audioConfigStream.Write(readBytes, readBytes.Length);
        } while (readBytes.Length > 0);

        var result = await speechRecognizer.RecognizeOnceAsync();
        Console.WriteLine($"RECOGNIZED: Text={result.Text}");
        Console.WriteLine(result);
    }

    async static Task Main(string[] args)
    {
        var speechConfig = SpeechConfig.FromSubscription(key, speechRegion);
        await FromStream(speechConfig);
    }

Arvig, Kris 0

When I run this example, it works:

This is the example that reads it from the File though, not Stream:

public static string _speechFileDir = @"C:\TestSpeechFiles\";
        public static string _filePath = _speechFileDir + "oh-yeah-everything-is-fine.wav";
        public async static Task FromFile(SpeechConfig speechConfig)
        {
            using var audioConfig = AudioConfig.FromWavFileInput(_filePath);
            using var speechRecognizer = new SpeechRecognizer(speechConfig, audioConfig);

            var result = await speechRecognizer.RecognizeOnceAsync();
            Console.WriteLine($"RECOGNIZED: Text={result.Text}");
            Console.WriteLine(result);
        }

This is what it returns:

RECOGNIZED: Text=Ohh yeah, everything's fine.

ResultId:686fe6c098034749ad2633e445f33057 Reason:RecognizedSpeech Recognized text:<Ohh yeah, everything's fine.>. Json:{"Id":"686fe6c098034749ad2633e445f33057","RecognitionStatus":"Success","DisplayText":"Ohh yeah, everything's fine.","Offset":1000000,"Duration":16300000,"Channel":0}

Arvig, Kris 0 Reputation points

2023-04-27T16:10:58.9966667+00:00

I'm using a Console App with Target Framework of .NET 7

YutongTie-MSFT 39,611 Reputation points

2023-04-27T06:31:55.81+00:00

Hello @Arvig, Kris Could you please share the error message when you tried below stream sample in the document to us?

using System; using System.IO; using System.Threading.Tasks; using Microsoft.CognitiveServices.Speech; using Microsoft.CognitiveServices.Speech.Audio; class Program { async static Task FromStream(SpeechConfig speechConfig) { var reader = new BinaryReader(File.OpenRead("PathToFile.wav")); using var audioConfigStream = AudioInputStream.CreatePushStream(); using var audioConfig = AudioConfig.FromStreamInput(audioConfigStream); using var speechRecognizer = new SpeechRecognizer(speechConfig, audioConfig); byte[] readBytes; do { readBytes = reader.ReadBytes(1024); audioConfigStream.Write(readBytes, readBytes.Length); } while (readBytes.Length > 0); var result = await speechRecognizer.RecognizeOnceAsync(); Console.WriteLine($"RECOGNIZED: Text={result.Text}"); } async static Task Main(string[] args) { var speechConfig = SpeechConfig.FromSubscription("YourSpeechKey", "YourSpeechRegion"); await FromStream(speechConfig); } }

Thanks a lot.
Arvig, Kris 0 Reputation points

2023-04-27T15:46:01.84+00:00

I just re-read your post... Let me try that code and update this
Arvig, Kris 0 Reputation points

2023-04-27T15:48:13.8466667+00:00

Ok this is the result I got:

RECOGNIZED: Text=

ResultId:7f453e588631461abf50258a71ee33d6 Reason:NoMatch Recognized text:<>. Json:{"Id":"7f453e588631461abf50258a71ee33d6","RecognitionStatus":"InitialSilenceTimeout","Offset":0,"Duration":106200000,"Channel":0}

This is the code I copied from your post, and then I put my variables in there:

public static string _speechFileDir = @"C:\TestSpeechFiles\"; public static string _filePath = _speechFileDir + "oh-yeah-everything-is-fine.wav"; async static Task FromStream(SpeechConfig speechConfig) { var reader = new BinaryReader(File.OpenRead(_filePath)); using var audioConfigStream = AudioInputStream.CreatePushStream(); using var audioConfig = AudioConfig.FromStreamInput(audioConfigStream); using var speechRecognizer = new SpeechRecognizer(speechConfig, audioConfig); byte[] readBytes; do { readBytes = reader.ReadBytes(1024); audioConfigStream.Write(readBytes, readBytes.Length); } while (readBytes.Length > 0); var result = await speechRecognizer.RecognizeOnceAsync(); Console.WriteLine($"RECOGNIZED: Text={result.Text}"); Console.WriteLine(result); } async static Task Main(string[] args) { var speechConfig = SpeechConfig.FromSubscription(key, speechRegion); await FromStream(speechConfig); }
Arvig, Kris 0 Reputation points

2023-04-27T15:58:02.2133333+00:00

When I run this example, it works:

This is the example that reads it from the File though, not Stream:

public static string _speechFileDir = @"C:\TestSpeechFiles\"; public static string _filePath = _speechFileDir + "oh-yeah-everything-is-fine.wav"; public async static Task FromFile(SpeechConfig speechConfig) { using var audioConfig = AudioConfig.FromWavFileInput(_filePath); using var speechRecognizer = new SpeechRecognizer(speechConfig, audioConfig); var result = await speechRecognizer.RecognizeOnceAsync(); Console.WriteLine($"RECOGNIZED: Text={result.Text}"); Console.WriteLine(result); }

This is what it returns:

RECOGNIZED: Text=Ohh yeah, everything's fine.

ResultId:686fe6c098034749ad2633e445f33057 Reason:RecognizedSpeech Recognized text:<Ohh yeah, everything's fine.>. Json:{"Id":"686fe6c098034749ad2633e445f33057","RecognitionStatus":"Success","DisplayText":"Ohh yeah, everything's fine.","Offset":1000000,"Duration":16300000,"Channel":0}
Arvig, Kris 0 Reputation points

2023-04-27T16:10:58.9966667+00:00

I'm using a Console App with Target Framework of .NET 7

How to send a byte array to Azure Speech Service (Speech to Text)

Activity