Annotate the technician's shared environment

Tip

Dynamics 365 Remote Assist customers now have access to Remote Assist in Microsoft Teams mobile. Take advantage of all that Teams has to offer and collaborate with other users!

Mixed-reality annotations give technicians and remote collaborators the power to visually specify an area or a particular asset in their environment to look at or manipulate. During a Dynamics 365 Remote Assist mobile video call, the technician shares their environment with the remote collaborator through their rear-facing camera. The technician can instantly place mixed-reality annotations in the shared environment. The remote collaborator places mixed-reality annotations on a snapshot of the technician's shared environment.

Note

Android devices that have a time-of-flight (ToF) sensor and support the Depth API and iOS devices that have a LiDAR sensor (see LiDAR sensor in the tables listed for iOS and iPadOS devices) are likely to have better accuracy with annotation placement.

Learn the annotation tools

Mobile app

If you're using the Dynamics 365 Remote Assist mobile app, you see the following annotation toolbar.

Screenshot of the Dynamics 365 Remote Assist mobile annotation toolbar.

If you select the down arrow next to the left-most button (the active tool), the button drops down.

Screenshot of the Dynamics 365 Remote Assist mobile annotation toolbar dropped down.

The following table describes each of the buttons in the mobile app annotation toolbar.

Button Description
Screenshot of Arrow button. Add an arrow.
Screenshot of Ink button. Add ink (draw).
Screenshot of Color picker button. Select a color for the annotation.
Screenshot of Undo button. Undo the last annotation that you placed in your environment.
Screenshot of Delete all button. Delete all annotations that you placed in your environment. You can't delete annotations placed by the remote collaborator.

Teams desktop app

If you're the remote collaborator and you're using Teams desktop, you see the following annotation toolbar.

Screenshot of the Teams desktop annotation toolbar.

The following table describes each of the buttons in the Teams desktop annotation toolbar.

Button Description
Screenshot of the Arrow button. Add an arrow.
Screenshot of the Ink button. Add ink (draw).
Screenshot of the Color picker button. Select a color for the annotation.
Screenshot of the Undo button. Undo the last annotation that you placed.
Screenshot of the Delete all annotations button. Delete all annotations that you placed during the session. You can't delete annotations placed by the technician.

Add an arrow annotation

  1. Make sure the arrow is selected in the annotation toolbar.

  2. Move your device around to position the dot on the object or area you want to highlight.

  3. Tap to place the ghost arrow on your device screen.

    Show ghost arrow in the Dynamics 365 Remote Assist mobile toolbar.

  4. Tap and drag the arrow in a circular motion (360 degrees) to rotate the arrow.

Add an ink annotation

  1. Make sure the Ink tool is selected in the annotation toolbar.

  2. Tap and drag on your screen to start drawing.

Add an annotation if you're a technician using Dynamics 365 Remote Assist mobile

  • As a technician, you can place annotations in your shared environment. The remote collaborator sees your annotations in real time on their device.

    Screenshot of Dynamics 365 Remote Assist mobile showing an annotation.

Add an annotation if you're a remote collaborator using Dynamics 365 Remote Assist mobile

  1. To add annotations, select Start annotating.

    Remote collaborator on RAM single screen.

    Tip

    To delete all annotations you add during an editing session, select the Delete all annotations button. button.

  2. You see a snapshot of the technician's environment. You can add your annotations to that snapshot.

    Technician Remote collaborator
    Screenshot of technician's mobile app screen. Screenshot of remote collaborator's mobile app screen.
  3. To stop adding annotations to the snapshot, select the Check mark button. You return to the technician's live video feed and your annotations automatically appear in the technician's environment.

Add an annotation if you're a remote collaborator using Teams desktop

  1. To add annotations, select Start editing.

    Screenshot of the Start Editing option in the Microsoft Teams meeting toolbar.

  2. You see a snapshot of the technician's environment. You can add your annotations to the snapshot.

    Technician Remote collaborator
    Screenshot of the technician's mobile app screen. Screenshot of the remote collaborator's Teams desktop screen.
  3. To stop adding annotations to the snapshot, select Stop editing. You return to the technician's live video feed and your annotations automatically appear in the technician's environment.

    Screenshot of a Microsoft Teams call window with emphasis on the stop editing button.