Azure Vision Product Recognition - Training custom model is stuck on training

Question

Hi

I am trying to train a custom model for use as product recogniser, products on shelf model.

I generate my own coco files and use the provided python script to verify the coco file is correct. I have also successfully trained other previous models using the same process.

For the last week, every model I try to train just sticks on Training status. it goes way beyond the budget hours. the latest model I have tried budget is 16 hours and its been training now for 24hours.. no error, it just never stops

I have read other Q&A posts from users with similar experience so I believe there is an issue with custom training?

I have attached a screenshot.. ill be happy to provide other details on a private message if required.

Thanks!

Answer 1

Hello @TimboBaggins , Thank you again for your time and patience throughout this issue.

The product team has identified the issue and worked on the fix. As per 4/22/2024 the PG team has fixed the bug of retry logic of failing job.

Please let us know if you still face issues. Sorry for the inconveniences.

I hope you understand.

Regards,

Vasavi