Holographic Remoting Version History

Article
03/03/2023

Note

This guidance is specific to Holographic Remoting on HoloLens 2 and Windows PCs running Windows Mixed Reality.

Version 2.9.3 (October 26, 2023)

Holographic Remoting using the OpenXR API now supports the XR_MSFT_scene_marker extension.
Holographic Remoting using the OpenXR API now supports GPU Adapter selection through the XrRemotingPreferredGraphicsAdapterMSFT extension struct.
Fixed Unity Hands Subsystem crash due to Timestamp assert.

Version 2.9.2 (June 14, 2023)

Fixed an issue that led to a timeout after 10 seconds when using the listen mode with the OpenXR API.

Version 2.9.1 (February 17, 2023)

Stability improvements for older remote versions.

Version 2.9.0 (February 13, 2023)

Holographic Remoting using the OpenXR API now supports:
- Timestamp conversion between player and remote.
- The XR_MSFT_spatial_graph_bridge extension (revision 2).
Added support for per app audio capturing.
Added easy reverse connection using QR codes to the Holographic Remoting player see Holographic Remoting Player.
Updated the official samples on GitHub to C++ 20.
Various bug fixes and stability improvements.

Version 2.8.1 (July 6, 2022)

Improved support for Azure Spatial Anchors

Version 2.8.0 (May 3, 2022)

Full feature support for the XR_MSFT_scene_understanding extension. With that, all scene compute features and scene compute consistencies are now supported.
Optimizations and latency reduction.
Fixed issues with multi-GPU systems.
Lots of other bug fixes and stability improvements.

Version 2.7.5 (March 23, 2022)

Various bug fixes and stability improvements.

Version 2.7.4 (February 8, 2022)

Fixed issue preventing the Holographic Remoting player, available via the Microsoft Store, from launching correctly.

Version 2.7.3 (February 7, 2022)

Fixed HEVC video decoding latency regression.

Version 2.7.2 (December 15, 2021)

Various bug fixes and stability improvements.

Version 2.7.1 (October 26, 2021)

Various bug fixes and stability improvements.

Version 2.7.0 (September 29, 2021)

Added support for the OpenXR extension XR_MSFT_spatial_anchor_persistence, which allows persistence and retrieval of spatial anchors across application sessions on a device.
Added a new user coordinate system type that can be used to synchronize spatial locations between custom players and remote applications.
Fixed an issue where connected and disconnected events from PlayerContext and RemoteContext could be broadcast concurrently or even in the wrong order. The broadcast now always happens in order, but prohibits blocking in an event handler to wait for the broadcast of a subsequent event.
Various bug fixes and stability improvements.

Version 2.6.2 (August 20, 2021)

Fixed an OpenXR quad layer composition issue that can negatively affect hologram stability.

Version 2.6.1 (July 20, 2021)

The XR_MSFT_holographic_remoting_speech extension now allows reinitialization of the speech recognizer with new parameters during a running session.
Fixed an issue where speech recognition reliability lessened over multiple connections.
Various bug fixes and stability improvements.

Version 2.6.0 (June 10, 2021)

Holographic Remoting using the OpenXR API now supports:
- The new XR_MSFT_holographic_remoting_speech extension, which allows applications to listen to custom speech commands in various languages.
- The XR_MSFT_scene_understanding extension. It provides applications with a high-level representation of the planes, meshes, and objects in the user's environment. The extension enables development of spatially aware applications. Note, XR_SCENE_COMPUTE_CONSISTENCY_OCCLUSION_OPTIMIZED_MSFT is the only consistency supported by xrComputeNewSceneMSFT in this version.
- The XR_MSFT_spatial_graph_bridge extension, which allows applications to create XrSpace handles to track the Spatial Graph Nodes of other Windows Mixed Reality device platform libraries or APIs. Note, with XR_SPATIAL_GRAPH_NODE_TYPE_STATIC_MSFT is the only node type supported by xrCreateSpatialGraphNodeSpaceMSFT in this version.
Holographic Remoting using the Mixed Reality API now supports:
- The SpatialGraphInteropPreview.CreateCoordinateSystemForNode overloads, which allow applications to track static Spatial Graph Nodes so that users can reason about places and things in their environment.
Holographic Remoting using both the OpenXR and Mixed Reality APIs now supports:
The Microsoft.MixedReality.SceneUnderstanding SDK. It allows applications to compute a description of the scene surrounding the user (such as walls, floors, and surfaces) providing quads, meshes, and content placement cues.
The Microsoft.MixedReality.QR SDK, which allows applications to track the location, size, and content of detected QR codes.
Over-Rendering, which reduces black regions at the sides on the HMD.
The OpenXR remote sample has been updated to include:
- An example of using the XR_MSFT_holographic_remoting_speech extension.
The Mixed Reality remote sample has been updated to include:
- An example of using the Microsoft.MixedReality.SceneUnderstanding SDK.
- An example of using the Microsoft.MixedReality.QR SDK (which replaces the previous QR code detection mechanism).
The Holographic Remoting player now shows a loading animation while the connection is being established.
Fixed issues with RenderDoc compatibility in both the OpenXR API runtime and the Mixed Reality API sample.
Various bug fixes and stability improvements.

Version 2.5.0 (February 12, 2021)

Holographic Remoting using the OpenXR API now supports:
XR_MSFT_spatial_anchor extension. This extension allows an application to create spatial anchors. Spatial anchors are arbitrary points in the user’s physical environment that will be tracked by the runtime.
- XR_MSFT_controller_model extension. This extension provides a mechanism to load GLTF models for controllers.
- Custom data channels as part of the XR_MSFT_holographic_remoting extension. An example for that is shown in the OpenXR remote sample.
Improved synchronization between player and remote side. The improvement allows dynamically changing pose and frame buffering, which ensures that remote rendered content smoothly reaches the displays at the expected target frame rate.
Improved performance of the Holographic Remoting player available via the Microsoft Store.
Optimized transmission of spatial surface meshes, which can be queried via SpatialSurfaceObserver by a remote app.
Fixed an issue in which calling SpatialAnchorManager methods or releasing anchors caused exceptions on disconnect.
Fixed threading issue leading to crashes when closing PlayerContext or RemoteContext instances.
Holographic Remoting Player on Desktop: Display an error message when Windows Mixed Reality is missing instead of closing silently.
Lots of other bug fixes and stability improvements.

Version 2.4.1 (January 22, 2021)

Fixed issue with SpatialAnchorManager::RequestStoreAsync not working reliably when called while connecting.
Fixed issue with SpatialAnchorManager::TrySave not correctly saving an anchor if the anchor in question can't be located.

Version 2.4.0 (December 1, 2020)

Holographic Remoting now support writing remote apps using the OpenXR API. Check out Writing a Holographic Remoting remote app using OpenXR APIs to get started.
Bug fixes and stability improvements.

Version 2.3.1 (October 10, 2020)

Fixed regression with remote pose prediction, which caused visual jitter.
Implemented PerceptionDeviceSetCreateFactoryOverride, which ensures that PerceptionDevice.dll shipped with Holographic Remoting doesn't interfere with the version shipped with Windows 10.

Version 2.3.0 (October 2, 2020)

Fixed crashes, which can happen when Holographic Remoting Player is suspended.
Stability improvements.

Version 2.2.3 (August 28, 2020)

Bug fixes and stability improvements.

Version 2.2.2 (July 10, 2020)

Fixed issue with HolographicCamera.LeftViewportParameters and HolographicCamera.RightViewportParameters not returning any hidden area mesh vertices when streaming from a Windows Mixed Reality headset.
Fixed crash, which can happen with poor network connection.

Version 2.2.1 (July 6, 2020)

Important

Windows App Certification Kit validation with version 2.2.0 will fail. In case you're on version 2.2.0 and want to submit your application to the Microsoft store p lease updated to at least version 2.2.1.

Fixed Windows App Certification Kit compliance issues.

Version 2.2.0 (July 1, 2020)

The Holographic Remoting player can now be installed on PCs running Windows Mixed Reality, making it possible to stream to immersive headsets.
Motion controllers are now supported by Holographic Remoting and controller-specific data can be retrieved via SpatialInteractionSource.Controller.
SpatialStageFrameOfReference is now supported and the current stage can be retrieved via SpatialStageFrameOfReference.Current. Also, a new stage can be requested via SpatialStageFrameOfReference.RequestNewStageAsync.
In previous versions, pose prediction was handled on the player side by the Holographic Remoting player. Starting with version 2.2.0, Holographic Remoting has time synchronization, and prediction is fully done by the remote application. Users should also expect improved hologram stability under difficult network situations.

Version 2.1.3 (May 25, 2020)

Changed behavior of HolographicSpace.CameraAdded event. In previous versions, it was not guaranteed that a newly added HolographicCamera also has a valid HolographicCameraPose when creating the next frame via HolographicSpace.CreateNextFrame. Starting with version 2.1.3, HolographicSpace.CameraAdded is synchronized with pose data coming from the Holographic Remoting Player. Users can expect that when a camera is newly added it also has a valid HolographicCameraPose available for that camera on the next frame.
Added Disabled to DepthBufferStreamResolution, which can be used to disable depth buffer streaming via RemoteContext.ConfigureDepthVideoStream. Note, if used HolographicCameraRenderingParameters.CommitDirect3D11DepthBuffer will fail with E_ILLEGAL_METHOD_CALL.
The Holographic Remoting Player's startup screen has been redesigned and now doesn't block the user's view.
Stability improvements and bug fixes.

Version 2.1.2 (April 5, 2020)

Fixed audio backwards compatibility issue between latest Holographic Remoting player and remote apps using version smaller than 2.1.0.
Fixed spatial anchor issue, which unexpectedly closed the Holographic Remoting player. This issue also affects custom players.

Version 2.1.1 (March 20, 2020)

Fixed video encoding issue with remote apps when using AMD GPUs.
Holographic Remoting Player performance improvements.

Version 2.1.0 (March 11, 2020)

Switched network transport to use RTP via UDP. Secure connections use SRTP now. Note, the Holographic Remoting Player is still compatible with all previously released Holographic Remoting versions. To benefit from the new network transport, both the Holographic Remoting Player and the remote app in question have to use version 2.1.0.
Added support for HolographicCameraRenderingParameters.CommitDirect3D11DepthBuffer.

Version 2.0.20 (February 2, 2020)

Fixed various bugs that lead to crashes.

Version 2.0.18 (December 17, 2019)

Added support for HolographicViewConfiguration
Fixed various bugs that lead to crashes.
Fixed bug where a HolographicSpace.CameraAdded callback was required for a HolographicCamera to get accepted and show up as added camera in the HolographicFrame.

Version 2.0.16 (November 11, 2019)

Fixed deadlock in QR code tracking.
Fixed unhandled exception because of a blocking wait in main thread.

Version 2.0.14 (October 26, 2019)

Support for new PerceptionDevice APIs (Windows 10 November 2019 Update).
Fixed issue, which prevents hold gesture events being triggered by SpatialGestureRecognizer.
Fixed threading issue when using SpatialSurfaceObserver.SetBoundingVolume.

Version 2.0.12 (October 18, 2019)

Fixed crash in SpatialGestureRecognizer when using NavigationRail(X/Y/Z).

Version 2.0.10 (October 10, 2019)

Fixed crash when using trigger button of VR controllers. Holographic Remoting doesn't fully support controllers, only the trigger button and the Windows button are working if paired with HoloLens 2.

Version 2.0.9 (September 19, 2019)

Added support for SpatialAnchorExporter
Added new interface IPlayerContext2 (implemented by PlayerContext) providing the following members:
- BlitRemoteFrameTimeout property.
Added Failed_RemoteFrameTooOld value to BlitResult
Stability and reliability improvements

Version 2.0.8 (August 20, 2019)

Fixed crash when calling HolographicCameraRenderingParameters.CommitDirect3D11DepthBuffer with a IDXGISurface2 as parameter.
Stability and reliability improvements

Version 2.0.7 (July 26, 2019)

First public release of Holographic Remoting for HoloLens 2.