Error when trying to sync two Azure Kinect with "green screen" example

Question

Hello,

It's already been a few days since I tried to test the following Green screen example but when I launch the code the program stay blocked when I try to get the captures from the master device. By lookin at the logs I get the following errors :

....
[2021-06-28 14:27:48.328] [error] [t=2264] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\capturesync\capturesync.c (142): replace_sample(). capturesync_drop, releasing capture early due to full queue TS: 946066 type:Depth
[2021-06-28 14:27:48.395] [error] [t=2264] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\capturesync\capturesync.c (142): replace_sample(). capturesync_drop, releasing capture early due to full queue TS: 1012733 type:Depth
[2021-06-28 14:27:48.461] [error] [t=2264] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\capturesync\capturesync.c (142): replace_sample(). capturesync_drop, releasing capture early due to full queue TS: 1079400 type:Depth
[2021-06-28 14:27:48.529] [error] [t=2264] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\capturesync\capturesync.c (142): replace_sample(). capturesync_drop, releasing capture early due to full queue TS: 1146066 type:Depth
.....

I investigated a lot on the problem without finding any solution.
I'm working with Windows 10 and with the v1.4.1 of the Azure Kinect SDK.
My computer got two GPU Nvidia Quatro RTX 6000 so I shouldn't have any problem with that.
Here is the firmware present in each camera (from the log file) :

[2021-06-28 14:27:44.735] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (343): find_libusb_device(). Container ID found: {8e095773-dbf1-4739-2bb9-d2020461d79f}
[2021-06-28 14:27:44.736] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (224): populate_serialnumber(). Serial Number found 000287401712
[2021-06-28 14:27:44.778] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (326): find_libusb_device(). Found non matching Container ID: {5e188cb9-bc2b-4fed-4f99-6a23b282a653}
[2021-06-28 14:27:44.779] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (343): find_libusb_device(). Container ID found: {8e095773-dbf1-4739-2bb9-d2020461d79f}
[2021-06-28 14:27:44.780] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (224): populate_serialnumber(). Serial Number found 000287401712
[2021-06-28 14:27:44.808] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (225): ******************** Device Info ********************
[2021-06-28 14:27:44.808] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (226): K4A SDK version: 1.4.1
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (232): Serial Number: 000287401712
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (236): RGB Sensor Version: 1.6.110
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (239): Depth Sensor Version:1.6.79
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (242): Mic Array Version: 1.6.14
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (245): Sensor Config: 6109.7
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (248): Build type: Release
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (253): Signature type: MSFT
[2021-06-28 14:27:44.833] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (259): ****************************************************
[2021-06-28 14:27:45.041] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (343): find_libusb_device(). Container ID found: {5e188cb9-bc2b-4fed-4f99-6a23b282a653}
[2021-06-28 14:27:45.042] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (224): populate_serialnumber(). Serial Number found 000194794412
[2021-06-28 14:27:45.075] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (343): find_libusb_device(). Container ID found: {5e188cb9-bc2b-4fed-4f99-6a23b282a653}
[2021-06-28 14:27:45.075] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\usbcommand\usbcommand.c (224): populate_serialnumber(). Serial Number found 000194794412
[2021-06-28 14:27:45.103] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (225): ******************** Device Info ********************
[2021-06-28 14:27:45.103] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (226): K4A SDK version: 1.4.1
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (232): Serial Number: 000194794412
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (236): RGB Sensor Version: 1.6.110
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (239): Depth Sensor Version:1.6.79
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (242): Mic Array Version: 1.6.14
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (245): Sensor Config: 6109.7
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (248): Build type: Release
[2021-06-28 14:27:45.128] [critical] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\depth\depth.c (253): Signature type: MSFT

And finally here is the config for each camera :

[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (868): k4a_device_start_cameras(). Starting camera's with the following config.
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (869): k4a_device_start_cameras(). color_format:0
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (870): k4a_device_start_cameras(). color_resolution:1
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (871): k4a_device_start_cameras(). depth_mode:4
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (872): k4a_device_start_cameras(). camera_fps:1
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (873): k4a_device_start_cameras(). synchronized_images_only:1
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (874): k4a_device_start_cameras(). depth_delay_off_color_usec:0
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (875): k4a_device_start_cameras(). wired_sync_mode:2
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (876): k4a_device_start_cameras(). subordinate_delay_off_master_usec:0
[2021-06-28 14:27:45.156] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (877): k4a_device_start_cameras(). disable_streaming_indicator:0
[2021-06-28 14:27:45.175] [info] [t=2264] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\dynlib\dynlib_windows.c (131): dynlib_create(). Depth Engine loaded C:\Users\achapin\Documents\Documents\SynchroCam\SynchroCam\depthengine_2_0.DLL
[2021-06-28 14:27:45.175] [info] [t=2264] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\deloader\deloader.cpp (51): verify_plugin(). Loaded Depth Engine version: 2.1.3
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (916): k4a_device_start_cameras(). k4a_device_start_cameras started
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (868): k4a_device_start_cameras(). Starting camera's with the following config.
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (869): k4a_device_start_cameras(). color_format:0
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (870): k4a_device_start_cameras(). color_resolution:1
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (871): k4a_device_start_cameras(). depth_mode:4
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (872): k4a_device_start_cameras(). camera_fps:1
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (873): k4a_device_start_cameras(). synchronized_images_only:1
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (874): k4a_device_start_cameras(). depth_delay_off_color_usec:80
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (875): k4a_device_start_cameras(). wired_sync_mode:1
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (876): k4a_device_start_cameras(). subordinate_delay_off_master_usec:0
[2021-06-28 14:27:45.666] [info] [t=7884] D:\a\1\s\extern\Azure-Kinect-Sensor-SDK\src\sdk\k4a.c (877): k4a_device_start_cameras(). disable_streaming_indicator:0

Thank you by advance !

Answer 1

Hello @Alexandre Chapin ,

We have come across the capturesync_drop, releasing capture early due to a "full queue" issue but that was related to using a USB expansion card/hub.

We can suggest perhaps using a different USB chipset. Using USB controllers from Intel did not have this issue. We also assume the 3.5 mm audio cable is less than 10 meters long as specified in the Azure Kinect docs.

Synchronize multiple Azure Kinect DK devices

Please comment in the below section for further help in this matter, we are happy to help you.