Check this reference sample for deploying ONNX models to IoT Edge devices. This reference implementation is using a DevOps pipeline to automate the retraining-deployment steps for CI/CD. It uses a keras->onnx conversion to generate the ONNX graph in the Jupyter notebook.
How to deploy a keras or tensorflow model on iot edge and inference using onnx runtime?
I have developed a classification model in keras. I wish to deploy this model onto iot edge device.How can I inference this model using onnx runtime..How to write the scoring script.Is there any good source to refer the same?
Just checking in to see if the below answer(s) helped.
If an answer is helpful, please "Accept answer" or "Up-Vote" for the same which might be beneficial to other community members reading this thread.
Sign in to comment
Sort by: Most helpful
Hello @Anurag Shelar
This is not a simple question to answer due to the many different ways of handling a model.
I recommend checking out the MS Learn modules for the AI Edge Engineer role first.
After that, check out this handson lab based on a yolo model on a Jetson Nano.
Last but not least, look at this page and follow workflow WF1.