Capture asset conditions with spatial markup in Dynamics 365 Remote Assist on HoloLens
Tip
Dynamics 365 Remote Assist customers now have access to Remote Assist in Microsoft Teams mobile. Take advantage of all that Teams has to offer and collaborate with other users! For the best calling experience on HoloLens, use Dynamics 365 Guides.
With Guides, the same remote experts can assist you through a problem while you have the holographic content of a Guide appearing before you.
Learn more and try Guides!
You can use Microsoft Dynamics 365 Remote Assist to capture procedures and defects during jobs such as an inspections or repairs. For example, a technician can use Dynamics 365 Remote Assist on HoloLens to capture photos or videos of the equipment they're inspecting, to highlight defects like wear and corrosion. The captures can then be viewed and downloaded from the Dynamics 365 Remote Assist model-driven app by stakeholders within the organization, such as a service manager or site superintendent.
In this tutorial, you'll learn how to use HoloLens to view asset records created from the Dynamics 365 Remote Assist model-driven app and capture photos and videos of assets with spatial markup.
Prerequisites
To complete this tutorial, you need:
Access to the environment Dynamics 365 Remote Assist is installed in. The account you used to sign in to Dynamics 365 Remote Assist needs access to the environment created in the first step and an active Dynamics 365 Remote Assist license.
Dynamics 365 Remote Assist app on HoloLens. Ensure you have downloaded the latest update to Dynamics 365 Remote Assist through the Microsoft Store. Ensure that you've selected the correct environment from the app settings.
Capture asset conditions
View the asset list
Select the Assets tab. The list of assets entered through the Dynamics 365 Remote Assist model-driven app are displayed in descending order by the last-modified date. At the bottom of the window, you can search for assets by using the Name field.
Note
The Assets tab is also accessible during a call. For example, while performing a real-time remote inspection, you can capture photos of the assets being inspected to the asset record from the Assets tab.
Capture photos or videos with spatial markup
On the Assets tab, select an asset from the list. You can also use the search bar at the bottom of the window.
Select the ink or arrow tools to mark up the asset in your environment. For example, you can circle an area of corrosion on a pipe.
Enable the Camera tool to start capturing photos or the Video tool to start capturing videos. The camera or video tool remains enabled after you take a photo or video.
If taking a photo capture, Air-tap or say the Snap voice command to take a picture of the asset with the spatial markup. The photo will be previewed for several seconds, and then saved to Microsoft Dataverse.
If taking a video capture, Air-tap or say the Start capture voice command to take a picture of the asset with the spatial markup. There will be a timer displayed counting down from the maximum video-length available. There will also be a red video icon to indicate that a video is being recorded. To stop recording the video capture, Air-tap or say the Stop capture.
Any existing photo can be selected in the asset view to preview in the HoloLens environment. If the current user took the photo, they can also delete that photo in the preview window.
Currently, captured video playback is not supported in the Dynamics 365 Remote Assist app on HoloLens.
Note
Captured photos and videos are saved both locally to HoloLens and to Microsoft Dataverse, where they're viewable from the Dynamics 365 Remote Assist model-driven app.
Next step
In this tutorial, you learned how to view assets in HoloLens and capture photos and videos to the asset record with spatial markup. In the next tutorial, you'll learn how to review the captured data from the Dynamics 365 Remote Assist model-driven app.