Can not use eye tracking in hololens2

Question

Can not use eye tracking in hololens2

成杰张 21

Recently, I suffered a very confusing problem that I can not use eye tracking in hololens2 after i deploy the eye tracking default example given by Microsoft. The details are below.

My versions:
unity 2020.3.25
MRTK 2.73

I followed and finished the tutorial named "Eye tracking examples overview" and its link:
https://learn.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/features/example-scenes/eye-tracking-examples-overview?view=mrtkunity-2021-05
But after i deploy the example into hololens2, there is a gaze cursor, but it can not follow my eyes, instead it seems to follow my head. And i can control the cursor to locate at the planer with four scenes: "target selecting", "navigating", "TargetPosition" and "visualizer" and use my hand pinch to select "target selecting". Though it works, when i make the cursor on one of the targets(gemstones), the target can not rotate. Above things mean that all functions work except eye tracking.

In addition, when deploying successfully, there is a window writing "eye calibration rocks". I try to flip the visor up and down, but the calibration can not happen. If i try to return to "setting" to calibrate and after calibration, the example scene disappears and i have to deploy it again. Finally, it becomes an infinite cycle...

By the way, the example of running in unity is fine.

How can i use eye tracking on hololens2? Where is my mistake?

Hernando Ren 2,151 Reputation points

2022-02-14T07:11:50.243+00:00

It is possible you have denied eye-tracking permission when starting the app on your HoloLens 2 for the first time. To use eye-tracking input, you can reset this in Settings → Privacy → Apps.
成杰张 21 Reputation points

2022-02-14T11:56:37.597+00:00

Thanks for your suggestion！ I have opened the permission, but it doesn't work, which means still can't use eye-tracking. Is there any other possible mistake that I have?
成杰张 21 Reputation points

2022-02-14T13:33:01.28+00:00

By the way, can I wear glasses to do eyes calibration?
Hernando Ren 2,151 Reputation points

2022-02-15T07:27:55.887+00:00

Of course, the eye-tracking system will not return any input if the user is not calibrated. You can find the eye calibration in the system settings: Settings > System > Calibration > Run eye calibration.
成杰张 21 Reputation points

2022-02-16T11:40:49.41+00:00

Thanks! I tried several times to open privacy and it was successfully! Thank you again!
成杰张 21 Reputation points

2022-02-20T06:02:06.94+00:00

I am so sorry to tell you that I still can not use eye-tracking in hololens2. After finishing the way(Settings → Privacy → Apps), I found that I can use eye-tracking in holographic remoting, however, I fail to use eye-tracking in hololens2 when deploying the default eye-tracking example provided by MRTK, even though I have calibrated using this way(Settings > System > Calibration > Run eye calibration). The example I used, name "Eye-tracking examples overview" and its link:
https://learn.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/features/example-scenes/eye-tracking-examples-overview?view=mrtkunity-2021-05
Pictures showing apps' privacy opened and eye calibration rocks are below:
成杰张 21 Reputation points

2022-02-20T06:03:09.957+00:00

I am so sorry to tell you that I still can not use eye-tracking in hololens2. After finishing the way(Settings → Privacy → Apps), I found that I can use eye-tracking in holographic remoting, however, I fail to use eye-tracking in hololens2 when deploying the default eye-tracking example provided by MRTK, even though I have calibrated using this way(Settings > System > Calibration > Run eye calibration). The example I used, name "Eye-tracking examples overview" and its link:
https://learn.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/features/example-scenes/eye-tracking-examples-overview?view=mrtkunity-2021-05
Pictures showing apps' privacy opened and eye calibration rocks are below:

Hernando Ren 2,151 Reputation points

2022-02-14T07:11:50.243+00:00

It is possible you have denied eye-tracking permission when starting the app on your HoloLens 2 for the first time. To use eye-tracking input, you can reset this in Settings → Privacy → Apps.
成杰张 21 Reputation points

2022-02-14T11:56:37.597+00:00

Thanks for your suggestion！ I have opened the permission, but it doesn't work, which means still can't use eye-tracking. Is there any other possible mistake that I have?
成杰张 21 Reputation points

2022-02-14T13:33:01.28+00:00

By the way, can I wear glasses to do eyes calibration?
Hernando Ren 2,151 Reputation points

2022-02-15T07:27:55.887+00:00

Of course, the eye-tracking system will not return any input if the user is not calibrated. You can find the eye calibration in the system settings: Settings > System > Calibration > Run eye calibration.
成杰张 21 Reputation points

2022-02-16T11:40:49.41+00:00

Thanks! I tried several times to open privacy and it was successfully! Thank you again!
成杰张 21 Reputation points

2022-02-20T06:02:06.94+00:00

I am so sorry to tell you that I still can not use eye-tracking in hololens2. After finishing the way(Settings → Privacy → Apps), I found that I can use eye-tracking in holographic remoting, however, I fail to use eye-tracking in hololens2 when deploying the default eye-tracking example provided by MRTK, even though I have calibrated using this way(Settings > System > Calibration > Run eye calibration). The example I used, name "Eye-tracking examples overview" and its link:
https://learn.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/features/example-scenes/eye-tracking-examples-overview?view=mrtkunity-2021-05
Pictures showing apps' privacy opened and eye calibration rocks are below:
成杰张 21 Reputation points

2022-02-20T06:03:09.957+00:00

I am so sorry to tell you that I still can not use eye-tracking in hololens2. After finishing the way(Settings → Privacy → Apps), I found that I can use eye-tracking in holographic remoting, however, I fail to use eye-tracking in hololens2 when deploying the default eye-tracking example provided by MRTK, even though I have calibrated using this way(Settings > System > Calibration > Run eye calibration). The example I used, name "Eye-tracking examples overview" and its link:
https://learn.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/features/example-scenes/eye-tracking-examples-overview?view=mrtkunity-2021-05
Pictures showing apps' privacy opened and eye calibration rocks are below:

Answer 1

Hello, Welcome to Microsoft Q&A,

The first thing we can check is the eye-tracking permission when starting the app on your HoloLens 2 for the first time. To use eye-tracking input, you can reset this in Settings → Privacy → Apps. Also, the eye-tracking system will not return any input if the user is not calibrated. You can find the eye calibration in the system settings: Settings > System > Calibration > Run eye calibration. For more information please see: Fallback when eye tracking isn't available

----
If the response is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

Answer 2

I just encountered a similar issue. Eye tracking works flawlessly when in I run my project in the Unity Editor(via Holographic Remoting) but doesn't do anything when I build and run on the HL2.
Luckily Joost van Schaik made a post about this on this on his blog: https://localjoost.github.io/Getting-Eye-Tracking-to-work-with-OpenXR-on-HoloLens-2/

In a nutshell, you don't only need set up your input profile for eye tracking, you also need to add an Eye Gaze Interaction Profile Porjects Settings -> XR Plug-in Management -> OpenXR -> Universal Windows Platform Settings tab -> Interaction Profiles

I hope this helps.

Can not use eye tracking in hololens2

1 additional answer

Activity