Azure Video Analyzer on Jetson Nano with GPU support

Robb F 1 Reputation point
2021-07-29T13:35:11.09+00:00

Hi,

Is there a way to use the Azure Video Analyzer archtitecture on Nvidia Jetson Edge devices (Nano or Xavier NX) with a GPU accelerated inference server?

So far I have only found tutorials using Nvidias Deepstream SDK as a substitute for the Azure Video Analyzer (AVA) module. However, by using the Deepstream SDK I wouldn't be able to take advantage of AVA's pipeline topology architecture for quick deployment of different use cases.

Instead, I would like to deploy my own inference server as a grpc extension module within the AVA pipeline (as indicated here). This would ideally be based on a container that sends inference jobs to the jetson gpu (maybe Nvidias Triton Server container?).

This seems to be the case in Microsofts OpenVino example, so essentially I would like to replicate this for Nvidias edge devices.

Azure IoT
Azure IoT
A category of Azure services for internet of things devices.
385 questions
Azure IoT Edge
Azure IoT Edge
An Azure service that is used to deploy cloud workloads to run on internet of things (IoT) edge devices via standard containers.
548 questions
{count} votes

2 answers

Sort by: Most helpful
  1. R. F 1 Reputation point
    2021-08-12T06:55:28.7+00:00

    Hi Yutong,
    thank you for the reply. I'have submitted a support ticket already, thank you.

    It definitely seems possible, but atm there is no official guide how to implement AVA on jetson devices.

    Thanks,
    Robby.


  2. Anil Murching 11 Reputation points Microsoft Employee
    2021-08-31T17:23:16.463+00:00

    Please see this for an example of how to build an inference server around DeepStream SDK, such that the server can be used with AVA.

    0 comments No comments