About microsoft / HoloLens2ForCV

Question

I found a research program resource set provided by microsoft, called HoloLens2ForCV, which is used to collect hand and eye tracking data during the use of Hololens2. However, the data file I exported does not contain the title of the data, so I can't interpret the data, I would like to ask where I can find the relevant description so that I can know what the data means.

Answer 1

Hello, Welcome to Microsoft Q&A,

Can you let me know if you used the Stream Recorder app to capture hand tracking and eye tracking data, and exported the following files?

If so, the file “XXX_head_hand_eye.csv” includes:

• One row per frame, collecting:
  • Timestamp in FILETIME
  • Head 6dof
  • Hand data: joint transforms if tracked (for both left and right hands) [Tracking might be lost e.g. in proximity of surfaces!]
  • Eye gaze data (if captured): origin / direction / distance
• Data in “world space” (origin depends on device location at app launch time)

For detailed information on the data that Stream Recorder captures, please refer to https://github.com/microsoft/HoloLens2ForCV/blob/main/Docs/ECCV2020-Tutorial/ECCV2020-ResearchMode-Repository.pdf.

If I misunderstood your question, please let me know.

---

If the response is helpful, please click "Accept Answer" and upvote it.

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.