Real world object detection

Question

Hi All,

 

I hope this is the right place to ask this question. If it is not, please point me to the right location. Thanks.

 

I have been asked to develop a HoloLens 2 healthcare application that should work as a guide for patients on how to handle different devices for blood sugar measurements, insulin pumps etc. But I need some help/information for how to do this the best way.

The HoloLens 2 application must be able to recognize the device (blood sugar measurement device) on the table, so that it can start telling what to do with it.

 

Are you able to help me with this?

 

Thank you in advance 

Answer 1

Hello, Welcome to Microsoft Q&A,

Try using Vuforia Engine, one of whose new features is Vuforia Model Targets, which allow applications to recognize physical objects like machines, automobiles, or toys and track them based on a CAD or digital 3D model. For further guidance, refer to Using Vuforia with Unity - Mixed Reality | Microsoft Learn.

---

If the response is helpful, please click "Accept Answer" and upvote it.

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

Answer 2

We've developed "DAS AI Mesh" for ML object detection on headsets.

https://www.dasxr.ai/spatial-computing-machine-learning-das-ai-mesh

Back in 2018, we developed an application that required athletic tracking on the Hololens 1. Due to all of the image processing that the Hololens does (i.w. for SLAM world tracking) models did not perform so well, so we had to go with traditional CV approaches (and achieved 8 FPS tracking which is sort of poor but worked for us).

Since then, we've developed DAS AI Mesh to help deploy models on AR/MR (and even the Vision Pro).

Best Regards,

Michael Dykier

DAS Labs