Azure Kinect doesn't work with Unity on RTX 3080.

Question

Azure Kinect doesn't work with Unity on RTX 3080.

翔太山野上 6

I'm trying to run the following project, which is an official Kinect sample.
https://github.com/microsoft/Azure-Kinect-Samples/tree/master/body-tracking-samples/sample_unity_bodytracking

It was said that it would not work as it is, so I set it referring to the following article.
https://qiita.com/Tuyoshi/items/343ce116d11e0cc9b797

What I did was mainly
· Restore NuGet packages
. Move missing files
-cdnn_cnn_infer64_8.dll
-cudnn_ops_infer64_8.dll
-cuff64_10.dll
. Script rewriting

I can run it in the same way with RTX 2070 without any problems, but I can't run it with RTX 3080.

I thought it was a problem with USB or device recognition, so I compared it, but there was no difference from the time of RTX 2070.

The operation of the sensor SDK and Body Tracking SDK itself has been confirmed.
Something is at stake only when running in Unity. Do you know what the cause is?
I would appreciate it if you could teach me.

António Sérgio Azevedo 7,671 Reputation points Microsoft Employee Moderator

2022-01-14T12:34:47.247+00:00

Hi @翔太山野上 can you confirm if this is the same issue? https://github.com/microsoft/Azure-Kinect-Sensor-SDK/issues/1728

Thanks!
翔太山野上 6 Reputation points

2022-01-17T06:46:58.923+00:00

Thank you for your reply.

The results of similar logs, but it is not possible to determine if the causes are the same.

For example, the same log may be output because the TrackerProcessingMode of SkeletalTrackingProVider.cs is GPU, CPU, CUDA.

In my case, it works on RTX 2070 and not on RTX 3080, so I think this is the cause.

If the GPU of the attached URL is RTX3080, the cause may be the same, but it cannot be determined because it is not described.
António Sérgio Azevedo 7,671 Reputation points Microsoft Employee Moderator

2022-01-19T11:19:37.59+00:00

Thanks for the confirmation. I have requested Product Team to have a look at the issue and will get back to you soon. Appreciate your time so far.
António Sérgio Azevedo 7,671 Reputation points Microsoft Employee Moderator

2022-01-26T16:41:22.603+00:00

Hello @翔太山野上 ,

A solution was provided on the related thread on github. Can you give it a try? Thanks!

https://github.com/microsoft/Azure-Kinect-Sensor-SDK/issues/1728

1 answer

Your answer

António Sérgio Azevedo 7,671 Reputation points Microsoft Employee Moderator

2022-01-14T12:34:47.247+00:00

Hi @翔太山野上 can you confirm if this is the same issue? https://github.com/microsoft/Azure-Kinect-Sensor-SDK/issues/1728

Thanks!
翔太山野上 6 Reputation points

2022-01-17T06:46:58.923+00:00

Thank you for your reply.

The results of similar logs, but it is not possible to determine if the causes are the same.

For example, the same log may be output because the TrackerProcessingMode of SkeletalTrackingProVider.cs is GPU, CPU, CUDA.

In my case, it works on RTX 2070 and not on RTX 3080, so I think this is the cause.

If the GPU of the attached URL is RTX3080, the cause may be the same, but it cannot be determined because it is not described.
António Sérgio Azevedo 7,671 Reputation points Microsoft Employee Moderator

2022-01-19T11:19:37.59+00:00

Thanks for the confirmation. I have requested Product Team to have a look at the issue and will get back to you soon. Appreciate your time so far.
António Sérgio Azevedo 7,671 Reputation points Microsoft Employee Moderator

2022-01-26T16:41:22.603+00:00

Hello @翔太山野上 ,

A solution was provided on the related thread on github. Can you give it a try? Thanks!

https://github.com/microsoft/Azure-Kinect-Sensor-SDK/issues/1728

Answer 1

Hello @翔太山野上 ,Thanks for posting this issue on this forum,

Below is the similar Github issue which was pointed ealrier by asergaz in his reply.

Just sharing to check if this may help with your scenario ? Please comment in the below section to get further help in this matter, happy to help further.

Related Github issue link: Unity BodyTracking Sample catching exception for background thread result = K4A_RESULT_FAILED

So after a lot of experimentation I was able to solve my issues:

OS with Version: Windows 10 Home 19042.1466
SDK Version: Azure Kinect SDK v1.4.1 / Azure Kinect Body Tracking SDK v1.0.1
Firmware version: Current Firmware Versions:
Unity Version: 2019.1.2f1

I tried a couple of things to get this working, so I can't tell which solved the issue but here's the list:

use the exact unity version of the project
use an older version of the body tracking sdk (1.0.1 vs 1.1.0)
copy everything in the tools folder of the body tracker sdk into the root of the unity project (same place as the assets folder)
Change ProcessingMode = TrackerProcessingMode.GPU to ProcessingMode = TrackerProcessingMode.Cuda (https://github.com/microsoft/Azure-Kinect-Samples/blob/master/body-tracking-samples/sample_unity_bodytracking/Assets/Scripts/SkeletalTrackingProvider.cs#L46)

翔太山野上 6 Reputation points

2022-02-25T01:43:02.82+00:00

Thank you for your answer.

I couldn't find a direct solution, but I was able to get some hints through various trials.
In conclusion, Kinect was able to work with the built Unity project. However, the same content still does not work when played in the editor.
I suspect that the Unity editor in this environment is blocking something.
It is difficult to investigate the cause in detail because it is not in the environment I have, but in the environment of proxies, security software, restricted networks, etc.

Thank you for your cooperation so far.

Share via

Azure Kinect doesn't work with Unity on RTX 3080.

1 answer

Your answer