Azure Communication Services Calling SDK for Unity doesn't support for Video Calling

Question

Azure Communication Services Calling SDK for Unity doesn't support for Video Calling

Sadev Kalubowila 10

Hi, I'm developing an immersive application for HoloLens by Unity. I have a requirement of integrate Azure Video Calling feature to the application. Video call should be establishe between HoloLens and PC. I tried this (https://learn.microsoft.com/en-us/azure/communication-services/quickstarts/voice-video-calling/get-started-with-video-calling?pivots=platform-unity) document. But I have encountered few issues and need support to sort them out.

I have noticed that there is a new beta release (1.0.0 - beta.2) of Azure Communication Services Calling Unity SDK. But seems the document is not update to match with that version as I got some errors on some methods of the document.

User's image

In the 1.0.0-beta.1 version I'm getting an runtime error in the Unity Editor as follows when trying to call. "InvalidOperationException: Unknown error.Azure.Communication.Calling.UnityClient.NativeLibraryHelpers.CheckStatus (System.IntPtr handle, Azure.Communication.Calling.UnityClient.Status value) (at Library/PackageCache/com.azure.communication.calling@9eb4a6f82e64/Runtime/Azure.Communication.Calling.UnityClient/Azure.Communication.Calling.UnityClient.cs:205)Azure.Communication.Calling.UnityClient.OutgoingVideoOptions.set_Streams (System.Collections.Generic.IReadOnlyList`1[T] value) (at Library/PackageCache/com.azure.communication.calling@9eb4a6f82e64/Runtime/Azure.Communication.Calling.UnityClient/Azure.Communication.Calling.UnityClient.cs:12574)AppManager.CallButton_Click () (at Assets/Scenes/AppManager.cs:66)System.Runtime.CompilerServices.AsyncMethodBuilderCore+<>c.<ThrowAsync>b__7_0 (System.Object state) (at <9d9536d9127f4a489d989c7a566aee1c>:0)UnityEngine.UnitySynchronizationContext+WorkRequest.Invoke () (at <120b8d04add741329ccd415c000fb666>:0)UnityEngine.UnitySynchronizationContext.Exec () (at <120b8d04add741329ccd415c000fb666>:0)UnityEngine.UnitySynchronizationContext.ExecuteTasks () (at <120b8d04add741329ccd415c000fb666>:0)"

User's image

But after comment below line of the CallButton_Click method,

" OutgoingVideoOptions = new OutgoingVideoOptions() { Streams = new OutgoingVideoStream[] { cameraStream } }"

then above error disappeared and only audio call establish. As video call function is the requirement, I kindly expecting support for solve the above issues.

Thanks

SnehaAgrawal-MSFT 22,516 Reputation points

2023-12-27T17:19:08.7866667+00:00

@Sadev Kalubowila Thanks for reaching here! I have reached out to internally to gather more information on this, will update you soon.
Sadev Kalubowila 10 Reputation points

2023-12-31T10:16:42.92+00:00

Thanks for the reply. As I mentioned , I tried the official documentation (https://learn.microsoft.com/en-us/azure/communication-services/quickstarts/voice-video-calling/get-started-with-video-calling?pivots=platform-unity) . But it didn't work for video calling. Hope it needs raw media enable within the Unity. I tried raw media access example (https://learn.microsoft.com/en-us/azure/communication-services/quickstarts/voice-video-calling/get-started-raw-media-access?pivots=platform-web)but it wasn't successful. Found some syntax errors most in Memory Buffer, hope the document is for .NET support UWP applications not for Unity. It would be highly appreciated if you can share a sample project that supports video calling feature both on HoloLens and Windows PC. Thanks
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

1 answer

Your answer

SnehaAgrawal-MSFT 22,516 Reputation points

2023-12-27T17:19:08.7866667+00:00

@Sadev Kalubowila Thanks for reaching here! I have reached out to internally to gather more information on this, will update you soon.
Sadev Kalubowila 10 Reputation points

2023-12-31T10:16:42.92+00:00

Thanks for the reply. As I mentioned , I tried the official documentation (https://learn.microsoft.com/en-us/azure/communication-services/quickstarts/voice-video-calling/get-started-with-video-calling?pivots=platform-unity) . But it didn't work for video calling. Hope it needs raw media enable within the Unity. I tried raw media access example (https://learn.microsoft.com/en-us/azure/communication-services/quickstarts/voice-video-calling/get-started-raw-media-access?pivots=platform-web)but it wasn't successful. Found some syntax errors most in Memory Buffer, hope the document is for .NET support UWP applications not for Unity. It would be highly appreciated if you can share a sample project that supports video calling feature both on HoloLens and Windows PC. Thanks
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

Answer 1

SnehaAgrawal-MSFT 22,516

@Sadev Kalubowila Update- Here is a Unity sample of utilizing raw video streams in Unity. Check this updated sample doc link- https://learn.microsoft.com/en-us/azure/communication-services/quickstarts/voice-video-calling/get-started-raw-media-access?pivots=platform-unity Please let us know if further query or issue remains.

Please accept as "Yes" if the answer provided is useful , so that you can help others in the community looking for remediation for similar issues.

Nicholas Plant 0 Reputation points

2024-02-07T14:32:51.3566667+00:00

@https://learn.microsoft.com/en-us/users/na/?userid=e58e5901-827f-4d8a-8125-dd1f8f8da424 thanks that is very useful. Is there going to be a calling hero example for Unity like the other platforms here https://learn.microsoft.com/en-us/azure/communication-services/samples/calling-hero-sample?pivots=platform-android
Nicholas Plant 0 Reputation points

2024-02-09T08:31:25.73+00:00

Hi, am getting An error occurred while resolving packages message: "Project has invalid dependencies: com.azure.communication.calling: TAR_ENTRY_INVALID: checksum failure com.unity.modules.accessibility: Package [com.unity.modules.accessibility@1.0.0] cannot be found com.unity.ugui: Package [com.unity.ugui@2.0.0] cannot be found"
Sadev Kalubowila 10 Reputation points

2024-02-14T00:18:18.69+00:00

Hi @SnehaAgrawal-MSFT . Thanks a lot for the update. I'm currently working on this with the updated document. Let me update you as soon as possible. Thank in advance
SnehaAgrawal-MSFT 22,516 Reputation points

2024-02-19T15:07:01.9933333+00:00

@Sadev Kalubowila Sure Please let us know.
Sadev Kalubowila 10 Reputation points

2024-03-23T16:13:33.97+00:00

Hi Sneha. Thanks a lot for the replying with all the references. I'm trying to build sample project here https://github.com/Azure-Samples/communication-services-dotnet-quickstarts/tree/main/Unity/RawVideo as UWP build to HoloLens 2 (ARM64 build). Unity UWP build gets success. But visual studio build gets fail with some errors. Can you help me to sort them out please.

Is there any limitations that above documentation is not work with Unity HoloLens applications?

Share via

Azure Communication Services Calling SDK for Unity doesn't support for Video Calling

1 answer

Your answer