Azure Kinect Body Tracking Unity 3D does not work/track body after reloading scene using SceneManager.LoadScene.

I've gotten the azure body tracking SDK to work. I am making a game with a restart functionality. However when I reload the scene using SceneManager.LoadScene and a button, after reloading, the body tracker ceases to work while the rest of my game is still working

LeelaRajeshSayana-MSFT 14,756 Reputation points Microsoft Employee

2023-01-09T23:47:17.353+00:00

Hello @Student - Mark Joshua Manacsa Pacheco , Welcome to Microsoft Q&A forum! Thanks for your query. Community SME's on this topic or our team will review your scenario and circle back at the possible earliest time.
LeelaRajeshSayana-MSFT 14,756 Reputation points Microsoft Employee

2023-01-12T23:30:23.43+00:00

Hi @Student - Mark Joshua Manacsa Pacheco can you share some code snippets of your game showing how you have initialized/laoding the game and part of the code that is responsible for restart.

I appreciate it if you can share any resources which you might have used in developing the game to test the code from our end.

Assuming that you are using Unity to develop the game, have you referred this article which explains the process of Loading a scene using a button click Please go through the steps outlined in the resource and let me know if it helps in addressing the issue you are facing.
LeelaRajeshSayana-MSFT 14,756 Reputation points Microsoft Employee

2023-01-18T19:54:29.38+00:00

Hi @Student - Mark Joshua Manacsa Pacheco Greetings! I am following up to see if you are still experiencing the issue. I appreciate it if you can share the above requested information to help us better understand the issue. Thank you

1 answer

QuantumCache 20,261

Hello,

This issue may be related to the way the Azure Kinect Body Tracking SDK is initialized and shutdown. When the scene is reloaded, the body tracking SDK may not be properly initialized again.

One possible solution is to create a separate script that handles the initialization and shutdown of the body tracking SDK. This script should be added to a GameObject that persists across scene changes.

private void Awake()
    {
        // Load the body tracking DLL
        bodyTrackingDllHandle = LoadLibrary(BodyTrackingDllPath);

        // Get the function pointers to the body tracking functions
        k4abt_tracker_create_func = GetProcAddress(bodyTrackingDllHandle, "k4abt_tracker_create");
        k4abt_tracker_destroy_func = GetProcAddress(bodyTrackingDllHandle, "k4abt_tracker_destroy");
        k4abt_tracker_enqueue_capture_func = GetProcAddress(bodyTrackingDllHandle, "k4abt_tracker_enqueue_capture");
        k4abt_tracker_pop_result_func = GetProcAddress(bodyTrackingDllHandle, "k4abt_tracker_pop_result");

        // Create the body tracking tracker handle
        int calibrationHandle = GetCalibrationHandle();
        k4abt_tracker_create_func(calibrationHandle, IntPtr.Zero, out trackerHandle);
    }

Student - Mark Joshua Manacsa Pacheco 1

When I build my unity executable and run it the second time it doesnt work, the kinect lights near the lens turn on for awhile and dies down. For the first time it ran the kinect lens light turns on continiously. How may I handle the initialisation and shutdown? my current main code does this:

using UnityEngine;

public class main : MonoBehaviour
{
    // Handler for SkeletalTracking thread.
    public GameObject m_tracker;
    private SkeletalTrackingProvider m_skeletalTrackingProvider;
    public BackgroundData m_lastFrameData = new BackgroundData();

    void Start()
    {
        //tracker ids needed for when there are two trackers
        const int TRACKER_ID = 0;
        m_skeletalTrackingProvider = new SkeletalTrackingProvider(TRACKER_ID);
    }

    void Update()
    {
        if (m_skeletalTrackingProvider.IsRunning)
        {
            if (m_skeletalTrackingProvider.GetCurrentFrameData(ref m_lastFrameData))
            {
                if (m_lastFrameData.NumOfBodies != 0)
                {
                    m_tracker.GetComponent<TrackerHandler>().updateTracker(m_lastFrameData);
                }
            }
        }
    }

    void OnApplicationQuit()
    {
        if (m_skeletalTrackingProvider != null)
        {
            m_skeletalTrackingProvider.Dispose();
        }
    }
}

Share via

Azure Kinect Body Tracking Unity 3D does not work/track body after reloading scene using SceneManager.LoadScene.

1 answer

Your answer