Share via

Real world object detection

Claus Thor Barth 0 Reputation points
2024-04-29T08:53:02.9966667+00:00

Hi All,

 

I hope this is the right place to ask this question. If it is not, please point me to the right location. Thanks.

 

I have been asked to develop a HoloLens 2 healthcare application that should work as a guide for patients on how to handle different devices for blood sugar measurements, insulin pumps etc. But I need some help/information for how to do this the best way.

The HoloLens 2 application must be able to recognize the device (blood sugar measurement device) on the table, so that it can start telling what to do with it.

 

Are you able to help me with this?

 

Thank you in advance 

HoloLens Development
HoloLens Development
HoloLens: A family of Microsoft self-contained, holographic devices that enable engagement with digital content and interaction with holograms in the surrounding environment.Development: The process of researching, productizing, and refining new or existing technologies.
385 questions
0 comments

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Ying Li - MSFT 810 Reputation points Microsoft Vendor
    2024-04-29T09:51:13.02+00:00

    Hello, Welcome to Microsoft Q&A,

    Try using Vuforia Engine, one of whose new features is Vuforia Model Targets, which allow applications to recognize physical objects like machines, automobiles, or toys and track them based on a CAD or digital 3D model. For further guidance, refer to Using Vuforia with Unity - Mixed Reality | Microsoft Learn.

    If the response is helpful, please click "Accept Answer" and upvote it.

    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

  2. Michael Dykier 0 Reputation points
    2024-04-30T15:12:23.3933333+00:00

    We've developed "DAS AI Mesh" for ML object detection on headsets.

    https://www.dasxr.ai/spatial-computing-machine-learning-das-ai-mesh

    Back in 2018, we developed an application that required athletic tracking on the Hololens 1. Due to all of the image processing that the Hololens does (i.w. for SLAM world tracking) models did not perform so well, so we had to go with traditional CV approaches (and achieved 8 FPS tracking which is sort of poor but worked for us).

    Since then, we've developed DAS AI Mesh to help deploy models on AR/MR (and even the Vision Pro).

    Best Regards,

    Michael Dykier

    DAS Labs