This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(307.2, 72%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EWT%3C/text%3E%3C/svg%3E)
Is it possible to use voice command with holographic remoting on Hololens2 with MRTK2?
I am using the MRTK 2.8.3 with OpenXR 1.8.1 in unity 2021.3.26.
I tried both Editor Play mode and windows standalone app with Enable Audio but the voice command is not detected.
The same scene is tested workable with UWP app.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(265.6, 1%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZW%3C/text%3E%3C/svg%3E)
[Edited]
Hello, Welcome to Microsoft Q&A,
What do you mean by 'the same scene is tested workable with UWP app'? What version of the Holographic Remoting Player app are you using? In versions 2.6.0 and later, Holographic Remoting Player already supports recognition of custom speech commands, please refer to Holographic Remoting Version History - Mixed Reality | Microsoft Learn. Also, please make sure you have given Holographic Remoting Player access to the microphone.
'The same scene is tested workable with UWP app' means when I build the same example scene as a UWP app, the speech control works fine. But the function of speech control failed to work on holographic remoting.
As you mentioned, I am wondering it is possible to test the speech control with the Hololens microphone when I run the project on my local computer with holographic remoting?
This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
Hi @WL.TSAI ,
Yes, it's possible. I tested this example scene - SpeechInputExample, and the voice commands work as expected in Remoting mode. Please make sure that your Holographic Remoting Player app is up to date and that you have given it microphone access on your HoloLens 2 device.
I have confirmed that my Holographic Remoting player is up-to-date and it has microphone permissions, but I still can’t successfully perform voice control in Remoting mode. It would be nice if you could provide the versions of Unity, MRTK, and OpenXR that you have successfully tested for my reference. Thank you.
The following is my test environment for your reference.
Thank you!
I’m using the same version, but it’s still not working. I conducted some tests with MRTK3 using the SpeechInputExample sample provided in https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity/tree/mainand encountered the following error in the unity editor with holographic remoting.
Could this error be related to the issue I’m experiencing with MRTK2.8? or does the backbone speech recognition stack is different between MRTK3 and MRTK2.X?
UnityException: Speech recognition is not supported on this machine.
UnityEngine.Windows.Speech.KeywordRecognizer..ctor (System.String[] keywords, UnityEngine.Windows.Speech.ConfidenceLevel minimumConfidence) (at <f712b1dc50b4468388b9c5f95d0d0eaf>:0)
MixedReality.Toolkit.Speech.Windows.WindowsKeywordRecognitionSubsystem+WindowsKeywordRecognitionProvider.Update () (at C:/Users/WANLUN.TSAI/workspace/UnityProject/MixedRealityToolkit-Unity/org.mixedrealitytoolkit.windowsspeech/Subsystems/WindowsKeywordRecognitionSubsystem.cs:135)
MixedReality.Toolkit.Subsystems.MRTKSubsystem`3[TSubsystem,TSubsystemDescriptor,TProvider].OnUpdate () (at Library/PackageCache/org.mixedrealitytoolkit.core@e0a4c2c13eef/Subsystems/MRTKSubsystem.cs:60)
MixedReality.Toolkit.Subsystems.MRTKSubsystem`3[TSubsystem,TSubsystemDescriptor,TProvider].MixedReality.Toolkit.Subsystems.IMRTKManagedSubsystem.Update () (at Library/PackageCache/org.mixedrealitytoolkit.core@e0a4c2c13eef/Subsystems/MRTKSubsystem.cs:26)
MixedReality.Toolkit.Subsystems.MRTKLifecycleManager.Update () (at Library/PackageCache/org.mixedrealitytoolkit.core@e0a4c2c13eef/Subsystems/MRTKLifecycleManager.cs:140)
I also got similar warning on the MRTK 2.8.3 SpeechInputExample. Both errors are testing with Unity Editor.
Failed to start keyword recognizer. Are microphone permissions granted? Exception: UnityEngine.UnityException: Speech recognition is not supported on this machine.
Failed to start dictation recognizer. Are microphone permissions granted? Exception: UnityEngine.UnityException: Speech recognition is not supported on this machine. at (wrapper managed-to-native) UnityEngine.Windows.Speech.DictationRecognizer.Create(object,UnityEngine.Windows.Speech.ConfidenceLevel,UnityEngine.Windows.Speech.DictationTopicConstraint) at UnityEngine.Windows.Speech.DictationRecognizer..ctor (UnityEngine.Windows.Speech.ConfidenceLevel minimumConfidence, UnityEngine.Windows.Speech.DictationTopicConstraint topic) [0x00008] in <f712b1dc50b4468388b9c5f95d0d0eaf>:0 at UnityEngine.Windows.Speech.DictationRecognizer..ctor () [0x00000] in <f712b1dc50b4468388b9c5f95d0d0eaf>:0 at Microsoft.MixedReality.Toolkit.Windows.Input.WindowsDictationInputProvider.InitializeDictationRecognizer () [0x0000f] in C:\workspace\UnityProject\wj6-hololens-viewer\Library\PackageCache\com.microsoft.mixedreality.toolkit.foundation@f2323a9b7aec\Providers\Windows\WindowsDictationInputProvider.cs:277 UnityEngine.Debug:LogWarning (object) Microsoft.MixedReality.Toolkit.Windows.Input.WindowsDictationInputProvider:InitializeDictationRecognizer () (at
I did some research, and this issue seems to be related to the application's running environment, you can refer to Speech recognition is not supported on this machine · Issue #4161 · microsoft/MixedRealityToolkit-Unity · GitHub. Since in Remoting mode, the application is still running on the local computer, could you please test whether the local computer supports Speech recognition first? For example, you can try Cortana, or you can run your project directly in the Unity Editor without Remoting Holographic.
Hi @Zuocheng Wang - MSFT
Thank you for your comprehensive guide. After enabling speech recognition on my local PC, I found that the SpeechInputExample works well with a microphone connected to my PC. However, I have a few additional questions I’d like to explore:
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(19.2, 55.00000000000001%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZK%3C/text%3E%3C/svg%3E)
Yes, it is possible to use voice commands with holographic remoting on HoloLens 2 with MRTK2.
To enable voice commands in your MRTK2 application, you'll need to do the following:
MRTK2 package to your project.MRTK2 settings, enable the Enable Audio option.MRTK2_Audio component to your main camera object.MRTK2_Audio component, set the Audio Input property to Microphone.MRTK2_Audio component, set the Audio Output property to None.MRTK2_Audio.GetAudioInput() function to access the audio input from the microphone.System.Speech.Recognition namespace to recognize speech and interpret voice commands.