Hololens2 Implementing Scene Understanding using MRTK and Unity

Asif Zahir 21 Reputation points
2021-11-30T02:07:33.013+00:00

Hey there,

I am trying to build a Unity Hololens2 app requires an mesh of an entire room for occlusion and an immersive feel. I am able to get a mesh of most of the room using the standard MRTK Spatial Observer but there are several holes. I was hoping to correct this using MRTK's Scene Understanding sdk. I also wanted to use Scene Understand to dynamically instantiate objects on the different planes that get picked up from the Scene Understanding sdk.

I tried to read through the articles online but unfortunately I cannot get it to work. Does anyone know the best way to implement Scene Understanding in an MRTK Unity project?

Thank you so much!

HoloLens Development
HoloLens Development
HoloLens: A family of Microsoft self-contained, holographic devices that enable engagement with digital content and interaction with holograms in the surrounding environment.Development: The process of researching, productizing, and refining new or existing technologies.
400 questions
{count} votes

Accepted answer
  1. Hernando Ren 2,171 Reputation points
    2021-12-01T08:51:47.167+00:00

    Hello, Welcome to Microsoft Q&A,

    "I tried downloading and launching the sample app on Unity 2020.3.21f but it crashed and opened the app on Safe mode."

    Please click "Ignore " to enter the project, and then open Build Setting for switching the Platform to the UWP, after doing this, the compilation errors will be solved.

    "How do I go about adding Scene understanding to my Unity projects? "

    It is recommended to import SceneUnderstanding SDK packages via the Mixed Reality Feature Tool. For more information please see: Where do I get the SDK?


    If the response is helpful, please click "Accept Answer" and upvote it.
    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.