Share via

I want HoloLens2 to recognize the voices of the people around me.

小松野　海斗 1 Reputation point
2021-11-18T07:33:45.747+00:00

I did HoloLens2 tutorials.
HoloLens2 tutorials -> https://learn.microsoft.com/ja-jp/learn/modules/azure-speech-services-tutorials-mrtk/3-exercise-integrate-speech-recognition-transcription
Development Environment ->
Unity2020.3.11f
Mixed Reality toolkit Foundation 2.7.2
Mixed Reality toolkit Standard Assets 2.7.2
Mixed Reality toolkit OpenXR Plugin 1.0.0

Now HoloLens2 can only recognize me own voice.
I want HoloLens2 to recognize the voices of the people around me.
I think that HoloLens2 will be recognized the voices of the people around me by Mixed Reality Toolkit Microphone Stream Selector.
But I do not know how to use Mixed Reality Toolkit Microphone Stream Selector.
Will be HoloLens2 recognized the voices of the people around me by Mixed Reality Toolkit Microphone Stream Selector?
Is there a solution other than installing another microphone?

@Tablet 150457-8891fc08f36f474ea5ed5449fe7a12c4.jpg

HoloLens Development
HoloLens Development
HoloLens: A family of Microsoft self-contained, holographic devices that enable engagement with digital content and interaction with holograms in the surrounding environment.Development: The process of researching, productizing, and refining new or existing technologies.
387 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Hernando Ren 2,166 Reputation points
    2021-11-19T08:34:21.567+00:00

    Hello, Welcome to Microsoft Q&A,

    To use Microphone Stream Selector, you need to build the solution first, and then contain the DLL file into MicStreamSelector/UnityAddon/Plugins/UWP/ARM64/ and add MixedRealityToolkit/Input/MicStreamSelector folder to your Unity project. After that, you can try to import all the types from Microsoft.MixedReality.Toolkit.Audio namespace by using directive and invoke the function from WindowsMicrophoneStream.cs.

    In your case, for pulling data from the microphones facing away from the user, please refer to this code: 

    var  envMic = new WindowsMicrophoneStream();  
envMic.Initialize(WindowsMicrophoneStreamType.RoomCapture);

    ----
    If the response is helpful, please click "Accept Answer" and upvote it.
    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

    0 comments