การฝึกอบรม
โมดูล
Add Azure AI services to your mixed reality project - Training
This course explores the use of Azure speech services by integrating to a hololens2 application. You can also deploy your project to a HoloLens.
Speech — MRTK2
Speech input providers, like Windows Speech Input, don't create any controllers but instead allow you to define keywords that will raise speech input events when recognized. The Speech Commands Profile in the Input System Profile is where you configure the keywords to recognize. For each command you can also:
- Select an input action to map it to. This way you can for example use the keyword Select to have the same effect as a left mouse click, by mapping both to the same action.
- Specify a key code that will produce the same speech event when pressed.
- Add a localization key that will be used in UWP apps to obtain the localized keyword from the app resources.
The Speech Input Handler script can be added to a GameObject to handle speech commands using UnityEvents. It automatically shows the list of the defined keywords from the Speech Commands Profile.
Assign optional SpeechConfirmationTooltip.prefab to display animated confirmation tooltip label on recognition.
Alternatively, developers can implement the IMixedRealitySpeechHandler interface in a custom script component to handle speech input events.
The SpeechInputExample scene, in MRTK/Examples/Demos/Input/Scenes/Speech, shows how to use speech. You can also listen to speech command events directly in your own script by implementing IMixedRealitySpeechHandler (see table of event handlers).
