Running Python Scripts

Question

Running Python Scripts

Jason G 1

We have been looking into trying to run a python script on the Microsoft Hololens 2, and we were unsure of the best way to go about it, or if it is even possible? Unity is able to run python scripts with third party software, but would that work once the app/program is deployed inside of the Hololens itself? We are trying to get a stream of images from the device, with relatively low latency. The Hololens app that allows wireless connection to the computer has a live feed, but there seems to be a dumping issue, and all of the data from the live feed is stored in the cache, and if the app isn't reloaded, it becomes very delayed and is no longer the live feed that we need. Research mode allows for more data to be collected from different sensors, but we are unsure about the best way to get a stream of images from it. Using Python would be ideal, but most tutorials and other people who have tried, used C++ or C#, and we are hoping there is an easy solution to this!

Seth DU - MSFT 541 Reputation points

2022-07-21T05:14:00.087+00:00

Hello, welcome to Microsoft Q&A,

There is no official documentation on supporting Python script for HoloLens. Since you are using Unity, you may have a try and implement your script via external plugin/software, but you may need to find support from Unity community.

Thus, I do not fully understand the scenario of dumping issue you have mentioned. Would you share more details? Do you encounter this issue when running the app with Remote Play and have you tried to deploy the project to HoloLens device for testing?
Jason G 1 Reputation point

2022-07-22T15:21:04.76+00:00

When we were using the livestream feature on the Microsoft Hololens app from the windows store, to see the live feed from the camera on the headset, it would slowly become more and more delayed, from starting at real time streaming from the device to being up to 3+ seconds behind sometimes. It would become fixed if we went into a separate tab on the app, like the camera section where you can take pictures and videos, and then go back to the livestream, which made us think that the cache where the livestream data was being stored never got dumped, causing it to become delayed. We are not sure at all about why it was becoming so delayed though, and that was just a theory we thought of at the time.

2 answers

Your answer

Seth DU - MSFT 541 Reputation points

2022-07-21T05:14:00.087+00:00

Hello, welcome to Microsoft Q&A,

There is no official documentation on supporting Python script for HoloLens. Since you are using Unity, you may have a try and implement your script via external plugin/software, but you may need to find support from Unity community.

Thus, I do not fully understand the scenario of dumping issue you have mentioned. Would you share more details? Do you encounter this issue when running the app with Remote Play and have you tried to deploy the project to HoloLens device for testing?
Jason G 1 Reputation point

2022-07-22T15:21:04.76+00:00

When we were using the livestream feature on the Microsoft Hololens app from the windows store, to see the live feed from the camera on the headset, it would slowly become more and more delayed, from starting at real time streaming from the device to being up to 3+ seconds behind sometimes. It would become fixed if we went into a separate tab on the app, like the camera section where you can take pictures and videos, and then go back to the livestream, which made us think that the cache where the livestream data was being stored never got dumped, causing it to become delayed. We are not sure at all about why it was becoming so delayed though, and that was just a theory we thought of at the time.

Answer 1

Hello, welcome to Microsoft Q&A,

According to the description, I believe you want to access the camera frames and stream them to external devices. it is difficult to debug a published app and you may need to implement your own streaming app. I don't think using Python script or research mode is the only proper direction to fulfill your requirement. A general solution is to implement Mixed reality capture overview to stream your app. Otherwise, you can also get video frames from Unity WebCamTexture() then implement your own streaming procedure in Unity.

---
If the response is helpful, please click "Accept Answer" and upvote it.

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

Answer 2

David Broggy 6,796 MVP Volunteer Moderator

Hi JasonG,
Straight up, I’m not aware of any python support for Hololens.
Reference:
choosing-an-engine

Share via

Running Python Scripts

2 answers

Your answer