It's currently in public preview, but have you possibly considered utilizing Azure Remote Rendering to get your point cloud rendered on the device. You can see more details here:
[https://learn.microsoft.com/en-us/azure/remote-rendering/overview/features/point-cloud-rendering