Mixed reality cloud services and applications
When you're developing mixed reality content, you'll likely run into scenarios where you need to store object placement information or render complex 3D models. Or you need to take advantage of cognitive services like speech translation and computer vision. Also, with Microsoft Mesh, people can collaborate on 3D models from remote locations, as if they're in the same room working with each other.
Mixed reality cloud services
You can use Azure Remote Rendering to render highly complex 3D models in real time and then stream them directly to a device by moving the rendering workload to high-end GPUs in the cloud. This service is especially important for applications that you might be developing for untethered devices, because they have less computational rendering power.
You can use Azure Spatial Anchors to build spatially aware applications. That means you can map, persist, and share holographic content across multiple devices at real-world scale. This service is cross-platform and is uniquely suited to way finding, multiuser experiences, and saving your object information.
Microsoft has several cognitive services that can be integrated into mixed reality applications. For example, the Speech service enables the integration of speech-processing capabilities into any app or service. You can convert spoken language into text or produce natural-sounding speech from text by using standard (or customizable) voice fonts.
Another example is the Vision service, which lets your app recognize, identify, caption, index, and moderate your pictures, videos, and digital ink content. It's even possible for your apps to accurately identify and analyze content within an image or video.
Dynamics 365 mixed reality applications
The Dynamics 365 Remote Assist application allows your users to get help or collaborate efficiently from different physical locations by using HoloLens, HoloLens 2, Android, or iOS devices. This feature is highly valuable in scenarios like maintenance and repair, remote inspections, or training sessions.
Microsoft Dynamics 365 Guides is a mixed reality application for Microsoft HoloLens that lets operators learn during the flow of work by providing holographic instructions when and where they're needed. These instruction cards are visually tethered to the place where the work must be done. They can include images, videos, and 3D holographic models.
Mesh enables people to connect with presence, share across space, and collaborate with one another, from anywhere in the world. By bringing Mesh-enabled mixed reality experiences to your organization, you can enhance virtual meetings, conduct virtual design sessions, help others remotely, and host immersive virtual meet-ups to boost productivity.
Mesh provides a natural collaboration experience in mixed reality. People are represented as 3D avatars in a shared space. Proximity and spatial audio let people know where they are relative to one another. Users can visualize and annotate content together in a shared 3D space. A user can look at the person they're talking to, and point to features on a shared 3D object.
Here are some common use cases for Microsoft Mesh:
Virtual collaboration: Colleagues working time zones apart can collaborate as if they’re physically in the same room. Mesh integrates with Microsoft 365, so connections, calendars, content, and workflows naturally transition to mixed reality. These shared experiences help deepen understanding, increase employee engagement and improve productivity.
Spatially aware design reviews: Mesh enhances 3D design reviews by enabling users to join from anywhere using any device. Whether physically present or holoported, colleagues can see and annotate 3D models in real-time. All content persists between design sessions so teams can quickly start where they left off. This common understanding ignites ideas, sparks creativity, and forms powerful bonds.
Help others remotely: When employees need help, there is nothing like having an expert right next to them to provide guidance and offer new perspectives. Mesh enables remote experts to be present wherever they are needed. They can overlay contextual data and help share insights quickly and effectively, resolving issues faster.
Train and learn together: Training, especially on complex topics such as surgery, equipment maintenance, and traffic control, is hard to do without being in the same room with the instructor and looking at the same set of objects from multiple perspectives. With Mesh, employees can learn together from anywhere thanks to holoportation, holographic sharing, and visualization. Mesh helps improve the efficacy of virtual training while reducing travel and logistics costs.
Host virtual meet-ups: Foster a deeper sense of connection and community by hosting virtual meet-ups in Mesh-powered mixed reality experiences. Form powerful bonds with others by letting your personality shine through as technology fades away.