I want HoloLens2 to recognize the voices of the people around me.

Question

I did HoloLens2 tutorials.
HoloLens2 tutorials -> https://learn.microsoft.com/ja-jp/learn/modules/azure-speech-services-tutorials-mrtk/3-exercise-integrate-speech-recognition-transcription
Development Environment ->
Unity2020.3.11f
Mixed Reality toolkit Foundation 2.7.2
Mixed Reality toolkit Standard Assets 2.7.2
Mixed Reality toolkit OpenXR Plugin 1.0.0

Now HoloLens2 can only recognize me own voice.
I want HoloLens2 to recognize the voices of the people around me.
I think that HoloLens2 will be recognized the voices of the people around me by Mixed Reality Toolkit Microphone Stream Selector.
But I do not know how to use Mixed Reality Toolkit Microphone Stream Selector.
Will be HoloLens2 recognized the voices of the people around me by Mixed Reality Toolkit Microphone Stream Selector?
Is there a solution other than installing another microphone?

@Tablet

Answer 1

Hello, Welcome to Microsoft Q&A,

To use Microphone Stream Selector, you need to build the solution first, and then contain the DLL file into MicStreamSelector/UnityAddon/Plugins/UWP/ARM64/ and add MixedRealityToolkit/Input/MicStreamSelector folder to your Unity project. After that, you can try to import all the types from Microsoft.MixedReality.Toolkit.Audio namespace by using directive and invoke the function from WindowsMicrophoneStream.cs.

In your case, for pulling data from the microphones facing away from the user, please refer to this code:

var  envMic = new WindowsMicrophoneStream();  
envMic.Initialize(WindowsMicrophoneStreamType.RoomCapture);  

----
If the response is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.