Tracking gaze interactions outside the window

Question

Looking at the new eye gaze tracking functionality:

https://learn.microsoft.com/en-us/windows/uwp/design/input/gaze-interactions

Is there a way to track gaze events for the whole screen, instead of just those that happen in the app window? I want to be able to use eye gestures as a sort of shortcut tool, but so far I can only figure out how to track gaze point data when my app window has focus.

Any pointers would be much appreciated!

Answer 1

Hello,

Welcome to Microsoft Q&A!

UWP apps could only get the events that happen inside its window. This is by design. UWP apps are different from traditional desktop apps. UWP apps can't handle such global system events like click events or gaze interactions outside the window. So this is not possible to implement this in UWP apps.

Thank you.

Answer 2

Gaze tracking (GT) is a new technology and will likely change and expand in the future. At this time the GT capabilities are available in UWP only. Because of this they function within the context of your app's window.

To capture gaze for the full screen you can expand your app to full screen. However, it sounds like your intent is to get gaze tracking for the entire system independent of the active window. Unfortunately this is not possible with the current GT implementation.

Do you have a specific scenario where you need access to gaze tracking for the entire system? If so please post it here in the comments. I can pass it along to the GT team so they can be aware of how our devs would like to use GT.

Answer 3

What does 'dt' in the eye tracking data represent? Is there a way to get the fixations?