API Availability for Measuring Hand Gesture and Speech Accuracy in HoloLens2 Experiment

Emery Lee 20 Reputation points


I would like to inquire about the availability of the speech recognition API and hand gesture API used in HoloLens2 for an experiment. I am interested in using these APIs to measure the accuracy of hand gestures and the speech accuracy of the experimenters. Could you please let me know if these APIs are provided?

Thank you.

HoloLens Development
HoloLens Development
HoloLens: A family of Microsoft self-contained, holographic devices that enable engagement with digital content and interaction with holograms in the surrounding environment.Development: The process of researching, productizing, and refining new or existing technologies.
390 questions
0 comments No comments
{count} votes

Accepted answer
  1. Zuocheng Wang - MSFT 3,086 Reputation points Microsoft Vendor

    Hello, Welcome to Microsoft Q&A,

    HoloLens does not provide an API for measuring the accuracy of gesture and speech recognition. You can try to implement it yourself.

    For speech recognition, Unity provides ConfidenceLevel and SpeechError, which may be useful to you.

    If the response is helpful, please click "Accept Answer" and upvote it.

    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful