Enable eye tracking and voice commands for objects on the HoloLens 2

Beginner
Developer
Windows
Windows Mixed Reality
Mixed Reality Toolkit
HoloLens
Azure
Mixed Reality Toolkit

In this module, you'll use eye tracking and voice commands in your Unity project and enhance user experience.

Learning objectives

By the end of this module, you'll be able to:

  • Learn how to enable eye tracking for HoloLens 2.
  • Learn how to use eye tracking to trigger action.
  • Learn how to create speech commands.
  • Learn how to control speech commands globally and locally.

Prerequisites

  • A Windows 10 or 11 PC configured with the correct tools
  • Windows 10 SDK 10.0.18362.0 or later
  • (Optional) A HoloLens 2 device configured for development
  • Unity Hub with Unity 2021.3 or later installed and the Universal Windows Platform Build Support module added
  • Complete the previous modules
  • Mixed Reality Feature Tool
  • Basic familiarity with Unity - interface, scene creation, package import, addition of GameObjects to a scene