Episode
Introduction to Deep Learning Models in Unreal
with Cassie Breviu
In this session we will explore different ways deep learning neural network models can and will be used in gaming. We will dive into different use cases and show how to leverage existing open-source model zoos. Then we will demo how to apply a PyTorch Style Transfer Model that does real time inferencing frame by frame. We will learn about the new experimental plugins, Neural Network Inference (NNI) that is powered by ONNX Runtime and OpenCV Helper that were released with Unreal Engine 5.
Recommended resources
- Join the Mixed Reality Developer Program to get the latest on our developer tools, events, and early access offers: https://aka.ms/IWantMR
- https://www.youtube.com/onnxruntime
- https://onnxruntime.ai/docs/
- https://twitter.com/onnxruntime
- https://www.linkedin.com/company/77691267/
- https://github.com/microsoft/OnnxRuntime-UnrealEngine
- Participate in the Mixed Reality Dev Days Online Hackathon now through July 8, 2022. Register to join at https://aka.ms/DevDaysHack
Connect
- Twitter: Cassie Breviu, @CassieBreviu
In this session we will explore different ways deep learning neural network models can and will be used in gaming. We will dive into different use cases and show how to leverage existing open-source model zoos. Then we will demo how to apply a PyTorch Style Transfer Model that does real time inferencing frame by frame. We will learn about the new experimental plugins, Neural Network Inference (NNI) that is powered by ONNX Runtime and OpenCV Helper that were released with Unreal Engine 5.
Recommended resources
- Join the Mixed Reality Developer Program to get the latest on our developer tools, events, and early access offers: https://aka.ms/IWantMR
- https://www.youtube.com/onnxruntime
- https://onnxruntime.ai/docs/
- https://twitter.com/onnxruntime
- https://www.linkedin.com/company/77691267/
- https://github.com/microsoft/OnnxRuntime-UnrealEngine
- Participate in the Mixed Reality Dev Days Online Hackathon now through July 8, 2022. Register to join at https://aka.ms/DevDaysHack
Connect
- Twitter: Cassie Breviu, @CassieBreviu
Have feedback? Submit an issue here.