Is onnx the best way to deal with azure iot edge Machine Learning models?

Question

Is onnx the best way to deal with azure iot edge Machine Learning models?

Anurag Shelar 181

I am working on Azure IOT Edge. I have three models.
a)yolov3 object detection model in .weights format
b)Resnet classfication model
c)VGG16 classification model in .h5 format.

I converted them to onnx and using onnx runtime inferenced them and wrote the necessary scoring scripts.

I wanted to know how do I use these models in original format without converting them to onnx or is onnx the best way for iot edge modules?

António Sérgio Azevedo 7,671 Reputation points Microsoft Employee Moderator

2021-01-05T12:10:22.4+00:00
Hello @Anurag Shelar ,
Please share with us if you have any other questions related with your original post. Otherwise could you go ahead and mark the below as answer so community members can benefit from a richer content? :)

Thank you so much.

Remember:

Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

2 answers

Your answer

António Sérgio Azevedo 7,671 Reputation points Microsoft Employee Moderator

2021-01-05T12:10:22.4+00:00

Hello @Anurag Shelar ,
Please share with us if you have any other questions related with your original post. Otherwise could you go ahead and mark the below as answer so community members can benefit from a richer content? :)

Thank you so much.

Remember:

Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

Answer 1

Manash Goswami 11 Microsoft Employee

If you didn't covert the models to ONNX then the respective inference engines will need to be included in your IOT-Edge module to run the inference.

ONNX provides the common format to represent the NN models from different training frameworks and execute using the same runtime, i.e. onnxruntime, on various edge device platforms. The same base docker image can be used to run the ONNX models across x86, arm64 devices with different accelerators like GPUs and VPUs.

0 comments

Answer 2

António Sérgio Azevedo 7,671 Microsoft Employee Moderator

Hi @Anurag Shelar it is not mandatory that you convert your models to onnx. Check this doc:

Open-source integration with Azure Machine Learning projects

"You can train, deploy, and manage the end-to-end machine learning process in Azure Machine Learning by using open-source Python machine learning libraries and platforms. Use development tools, like Jupyter Notebooks and Visual Studio Code, to leverage your existing models and scripts in Azure Machine Learning."

Thanks.

0 comments

Share via

Is onnx the best way to deal with azure iot edge Machine Learning models?

2 answers

Your answer