Training
Module
Enable eye tracking and voice commands for objects on the HoloLens 2 - Training
This course provides the user an overall understanding on how to use eye tracking and voice commands
This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
Ready to explore the world of holograms?
This guide provides an intro to:
On HoloLens, holograms blend the digital world with your physical environment to look and sound like they're part of your world. Even when holograms are all around you, you can always see your surroundings, move freely, and interact with people and objects. We call this experience "mixed reality".
The holographic frame positions your holograms where your eyes are most sensitive to detail and the see-through lenses leave your peripheral vision clear. With spatial sound, you can pinpoint a hologram by listening, even if it’s behind you. And, because HoloLens understands your physical environment, you can place holograms on and around real objects such as tables and walls.
Getting around HoloLens is a lot like using your smart phone. You can use your hands to touch and manipulate holographic windows, menus, and buttons.
Once you know these basic interactions, getting around on HoloLens will be a snap.
Tip
If you have a HoloLens near you right now, the Tips app provides literal hands-on tutorials for hand interactions on HoloLens.
Use the start gesture to go to Start or say "Go to Start" and select Tips.
HoloLens has sensors that can see a few feet to either side of you. When you use your hands, you'll need to keep them inside that frame, or HoloLens won't see them. However, the frame moves with you as you move around.
When a hologram is near you, bring your hand close to it and a white ring should appear on the tip of your index finger. This is the touch cursor which helps you touch and interact with holograms with precision. To select something, simply tap it with the touch cursor. Scroll content by swiping on the surface of the content with your finger, just like you're using a touch screen.
To grab a hologram near you, pinch your thumb and index finger together on the hologram and hold. To let go, release your fingers. Use this grab gesture to move, resize, and rotate 3D objects and app windows in mixed reality home.
To bring up a context menu, like the ones you'll find on an app tile in the Start menu, tap and hold like you do on a touch screen.
When there are no holograms near your hands, the touch cursor will hide automatically and hand rays will appear from the palm of your hands. Hand rays allow you to interact with holograms from a distance.
Tip
If you find hand rays distracting, you can hide them by saying “Hide hand rays”. To make them reappear, say "Show hand rays."
To select something using hand ray, follow these steps:
Use a hand ray from your palm to target the item. You don't need to raise your entire arm, you can keep your elbow low and comfortable.
Point your index finger straight up toward the ceiling.
To perform the air tap gesture, pinch your thumb and index finger together and then quickly release them.
To grab a hologram or scroll app window content using hand ray, start with an air tap, but keep your fingers together instead of releasing them.
Use air tap and hold to perform the following actions with hand ray:
The Start gesture opens the Start menu. To perform the Start gesture, hold out your hand with your palm facing you. You’ll see a Start icon appear over your inner wrist. Tap this icon using your other hand. The Start menu will open where you’re looking.
Tip
To close the Start menu, do the Start gesture when the Start menu is open. You can also look at the Start menu and say "Close".
Important
For the one-handed Start gesture to work:
You can also perform the Start gesture with only one hand. To do this, hold out your hand with your palm facing you and look at the Start icon on your inner wrist. While keeping your eye on the icon, pinch your thumb and index finger together.
Ready to put all these hand interactions to the test?!
You'll find your installed apps in the Start menu and you can find additional apps for HoloLens in the Microsoft Store.
Just as Windows PC always starts its experience at the desktop, HoloLens always starts in mixed reality home when turned on. Using the Start menu, you can open and place app windows, as well as app launchers and 3D content in mixed reality home. Their placements in your physical space will be remembered by HoloLens.
Open the Start menu, then select the Settings app tile. An app window will open in front of you.
Settings is an example of a HoloLens app that uses a 2D app window. It's very similar to a Windows application on PC.
Now you can open the Start menu again and select the Tips app tile. A 3D app launcher for the app will appear in front of you. To open the app, you need to select the play button on the launcher.
Tips is an example of an immersive app. An immersive app takes you away from mixed reality home when it runs and becomes the only app you see. To exit, you need to bring up the Start menu and select the mixed reality home button at the bottom.
A new menu that allows the user to sign out, shut down and restart the device. An indicator in the HoloLens Start screen that shows when a system update is available.
Open the HoloLens Start screen using the Start gesture or saying "Go to Start".
Notice the ellipsis icon (...) next to the user profile picture:
Select the user profile picture using your hands or the voice command "Power".
A menu appears with options to Sign out, Restart or Shut down the device:
Select the menu options to sign out, restart or shut down your HoloLens. The Sign out option might not be available, if the device is set up for a single Microsoft Account (MSA) or local account.
Dismiss the menu by touching anywhere else or closing the Start menu with the Start gesture.
Go here to learn more about Start menu and mixed reality home, including info on how to use and manage apps on HoloLens 2.
In mixed reality home you can move, resize, and rotate app windows and 3D objects using your hands, hand ray and voice commands.
Move a hologram or app by following these steps:
Grab and use the resize handles that appear on the corners of 3D holograms and app windows to resize them.
For an app window, when resized this way the window content correspondingly increases in size and becomes easier to read.
If you want to resize an app window so that more content appears in the window, use the resize handles located on the sides and bottom edges of the app window.
There are two ways to resize a hologram that's further away from you. You can either grab two corners of the hologram, or use the resize controls.
For 3D holograms, grab and use the rotate handles that appear on the vertical edges of the bounding box.
For app windows, moving an app window will cause it to automatically rotate and face you.
You can also grab a 3D hologram or app window with both hands (or hand ray) at once and then:
Holograms and app windows stay where you placed them in the world. That's not always convenient if you need to move around and you want an application to stay visible. To ask an app to start or stop following you, select Follow me in the top right corner of the app window (next to the Close button). An app window that is following you will also follow you into, an out of, an immersive app.
You can use your voice to do most of the same things you do with hands on HoloLens, like taking a quick photo or opening an app.
To do this | Say this |
---|---|
Open the Start menu | "Go to Start" |
Select | Say "select" to bring up the gaze cursor. Then, turn your head to position the cursor on the thing you want to select, and say “select” again. |
See available speech commands | "What can I say?" |
See more voice commands and ways to use speech with HoloLens
Some customers find it faster to "type" on virtual keyboards by swiping the shape of the word they intend to type. Now with Windows Holographic, version 21H1, you can swipe one word at a time by passing the tip of your finger through the plane of the holographic keyboard, swiping the shape of the word, and then withdrawing the tip of your finger from the plane of the keyboard. You can swipe follow up words without needing to press the space bar by removing your finger from the keyboard between words. You will know the feature is working if you see a swipe trail following your finger's movement on the keyboard.
Please note, this feature can be tricky to use and master because of the nature of a holographic keyboard where you don't feel resistance against your finger (unlike a mobile phone display). We are evaluating this feature for public release, so your feedback is important; whether you find the feature useful or you have constructive feedback, please let us know via Feedback Hub.
Congratulations! You're ready to use HoloLens 2!
Now you can configure your HoloLens 2 to meet your specific needs. Other things you may want to try include:
Tip
Try the Designing Holograms app.
If you are an IT admin, review the Common Deployment Scenarios for help in deploying HoloLens 2 to your organization.
Training
Module
Enable eye tracking and voice commands for objects on the HoloLens 2 - Training
This course provides the user an overall understanding on how to use eye tracking and voice commands