API Availability for Measuring Hand Gesture and Speech Accuracy in HoloLens2 Experiment

Question

Hello,

I would like to inquire about the availability of the speech recognition API and hand gesture API used in HoloLens2 for an experiment. I am interested in using these APIs to measure the accuracy of hand gestures and the speech accuracy of the experimenters. Could you please let me know if these APIs are provided?

Thank you.

Answer 1

Hello, Welcome to Microsoft Q&A,

HoloLens does not provide an API for measuring the accuracy of gesture and speech recognition. You can try to implement it yourself.

For speech recognition, Unity provides ConfidenceLevel and SpeechError, which may be useful to you.

---

If the response is helpful, please click "Accept Answer" and upvote it.

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.