Azure Percept eye module problem

Tom Fanara 141

Hello my Vision module on my IoT Azure percept DK is not working. Just seemed to have stopped. Please see device logs on eyemodule below. Any help would be great!

Inference App Version: 2021-05-04
2021-07-16 04:07:59 ERROR: Unrecognized string format for model data. Given a URL or zip or XML or blob file of path:
2021-07-16 04:07:59 ERROR: Could not load the desired type of model. Using a default one instead.
2021-07-16 04:07:59 rm -rf /app/model && mkdir /app/model
2021-07-16 04:07:59 libusb_open_device_with_vid_pid VID 0x3e7 PID 0x2485 found
2021-07-16 04:07:59 Raw RTSP Stream's resolution changed to native
2021-07-16 04:07:59 Raw RTSP stream enabled
2021-07-16 04:07:59 Raw RTSP Stream's FPS changed to 10
2021-07-16 04:07:59 Result RTSP Stream's resolution changed to native
2021-07-16 04:07:59 Result RTSP stream enabled
2021-07-16 04:07:59 Result RTSP Stream's FPS changed to 10
2021-07-16 04:07:59 H.264 Stream's resolution changed to native
2021-07-16 04:07:59 H.264 RTSP stream enabled
2021-07-16 04:07:59 H.264 Stream's FPS changed to 10
2021-07-16 04:07:59 RTSP thread created.
2021-07-16 04:07:59 Data collection thread created.
2021-07-16 04:07:59 rm -rf /app/snapshot/ && mkdir /app/snapshot/
2021-07-16 04:07:59 libusb_open_device_with_vid_pid VID 0x3e7 PID 0x2485 found
2021-07-16 04:07:59 Loading label file /app/data/labels.txt
2021-07-16 04:07:59 blobs: /app/data/ssd_mobilenet_v2_coco.blob, , firmware: /eyesom/mx.mvcmd, parser: SSD, label: /app/data/labels.txt, classes: 183

AshokPeddakotla-MSFT 27,571 Reputation points

2021-07-16T14:14:08.26+00:00

@Tom Fanara Welcome to Microsoft Q&A forum!
Did you check the troubleshooting guide? Vision solution troubleshooting and Azure Percept known issues
Mike McCoy - MSFT 606 Reputation points

2021-07-16T15:51:17.303+00:00

@AshokPeddakotla-MSFT - This might be something different than the highlighted "too many levels of symbolic links" error.

Hi @Tom Fanara - were you running a custom model when this happened? If so, had you made any changes to that model?
Tom Fanara 141 Reputation points

2021-07-16T20:39:54.993+00:00

yes I deployed a custom vision model

Accepted answer

Mike McCoy - MSFT 606 Reputation points

2021-07-16T20:45:14.763+00:00

@Tom Fanara

It looks like the model.zip file that is being deployed to the dev kit has an issue. Can you validate that the zip file and its content is not corrupted. Make sure that you can access the URL and download it from your browser.

From the logs it looks like you are using ssd_mobilenet_v2_coco.blob model file which is generated from this transfer learning notebook azure-percept-advanced-development/transfer-learning-using-ssd.ipynb at main · microsoft/azure-percept-advanced-development (github.com).
Please sign in to rate this answer.
Tom Fanara 141 Reputation points

2021-07-16T20:44:30.057+00:00

My custom vision model worked great for a week then maybe after I deployed the vision upgrade it broke it not sure. It was an upgrade from Azure Percept Studio under the device General tab

Mike McCoy - MSFT 606 Reputation points

2021-07-16T20:47:14.58+00:00

Can you clarify how you deployed the vision upgrade?

Mike McCoy - MSFT 606 Reputation points

2021-07-16T20:51:33.167+00:00

here is the correct url to that ipynb notebook. https://github.com/microsoft/azure-percept-advanced-development/blob/main/machine-learning-notebooks/transfer-learning/transfer-learning-using-ssd.ipynb

Tom Fanara 141 Reputation points

2021-07-16T21:02:27.547+00:00

it was a Vision upgrade that was listed here

Tom Fanara 141 Reputation points

2021-07-16T21:05:05.46+00:00

yes I saw the Vision upgrade here

Tom Fanara 141 Reputation points

2021-07-16T21:07:11.627+00:00

Now i see a speech Upgrade here that was similar

Tom Fanara 141 Reputation points

2021-07-16T21:08:32.73+00:00

Then I did an Over the Air full firmware deployment using a group

Tom Fanara 141 Reputation points

2021-07-17T03:39:57.367+00:00

I upgrades my firmware via USB and still getting the eyemodule errors below...

Mike McCoy - MSFT 606 Reputation points

2021-07-19T16:14:37.793+00:00

Hi @Tom Fanara - thanks for checking this. I think it rules out any issues with the hardware, software or firmware. All indications is it is an issue with the model.zip which we are discussing in the other part of this thread.

Mike McCoy - MSFT 606 Reputation points

2021-07-19T18:25:23.007+00:00

@Tom Fanara - It looks like you are trying to use the ssdmobilenetv2 model from the transfer learning tutorial (https://github.com/microsoft/azure-percept-advanced-development/blob/main/machine-learning-notebooks/transfer-learning/transfer-learning-using-ssd.ipynb). Can you confirm that you've followed all of the steps in that notebook? In particular the steps to upload the model.zip to your storage account.

Also, have you tried deploying any of the sample models from Percept Studio? See these instructions: https://learn.microsoft.com/en-us/azure/azure-percept/how-to-deploy-model
Sign in to comment

2 additional answers

Tom Fanara 141 Reputation points

2021-07-19T06:07:54.897+00:00

Yes I think you are right. Here is the image URL from the device screen. Is this the right place to get the model.zip? It just redirects ro a git hub page for registered containers if I browse it!

mcr.microsoft.com/azureedgedevices/azureeyemodule:preload-devkit
Please sign in to rate this answer.
Mike McCoy - MSFT 606 Reputation points

2021-07-19T16:10:01.363+00:00

Hi @Tom Fanara - thanks for this information. I'm investigating.

Tom Fanara 141 Reputation points

2021-07-19T16:29:09.457+00:00

Thank you so much sir as I have upgraded 4 times using USB!

Mike McCoy - MSFT 606 Reputation points

2021-07-19T17:02:34.067+00:00

@Tom Fanara - I'm so sorry you've had to do that! I don't think any more updates are necessary. I've got some engineers investigating the model.zip. Hopefully we'll have a solution soon.

Tom Fanara 141 Reputation points

2021-07-19T17:36:46.597+00:00

ah no problem I need the practice LOL! Looking forward to what they have to say! see attached pic of Vision module is this the correct connection port setup?

Mike McCoy - MSFT 606 Reputation points

2021-07-19T17:41:30.02+00:00

@Tom Fanara - your picture shows something plugged into the USB-A port. Just to confirm, your Vision device should be connected to the USB-C port on the dev board.

Tom Fanara 141 Reputation points

2021-07-19T19:57:51.177+00:00

Thats the Speech module or microphone USB A (dev board) to USB C (Microphone device) connection. For the Vision device I have USB C to C. Is that correct?

Tom Fanara 141 Reputation points

2021-07-19T20:05:23.053+00:00

Interesting my eyemodule is running now see below but I bet if I deploy out a model it takes it down.

Mike McCoy - MSFT 606 Reputation points

2021-07-20T13:59:43.627+00:00

@Tom Fanara - yes, that is correct
Sign in to comment
Tom Fanara 141 Reputation points

2021-07-19T20:22:38.147+00:00

ok its all working even my custom model see below. Don't know exactly what fixed it. Maybe there was a breakage in the docker image or container deployment?
Please sign in to rate this answer.
Mike McCoy - MSFT 606 Reputation points

2021-07-19T21:11:16.153+00:00

@Tom Fanara - Happy to see it working!

Tom Fanara 141 Reputation points

2021-07-19T21:12:29.787+00:00

Yes and thanks for all the help but I don't know what fixed it?

Tom Fanara 141 Reputation points

2021-07-19T21:12:47.613+00:00

any thoughts?

Mike McCoy - MSFT 606 Reputation points

2021-07-20T14:01:06.2+00:00

@Tom Fanara - besides USB updating the device software, what other troubleshooting steps did you try?

Tom Fanara 141 Reputation points

2021-07-20T14:12:31.773+00:00

Just checked USB cable but that's it. I'm hesitant on running the updates again as it could break the models not sure.

Mike McCoy - MSFT 606 Reputation points

2021-07-20T14:25:28.783+00:00

OK - thanks for the information.

Harrington McDowelle 1 Reputation point Microsoft Employee

2022-08-30T21:17:23.7+00:00

Hello, is there any update on this? I am facing a similar issue
Sign in to comment