Azure Vision Product Recognition - Training custom model is stuck on training

TimboBaggins 25 Reputation points
2024-04-11T21:06:37.2866667+00:00

Hi

I am trying to train a custom model for use as product recogniser, products on shelf model.

I generate my own coco files and use the provided python script to verify the coco file is correct. I have also successfully trained other previous models using the same process.

For the last week, every model I try to train just sticks on Training status. it goes way beyond the budget hours. the latest model I have tried budget is 16 hours and its been training now for 24hours.. no error, it just never stops

I have read other Q&A posts from users with similar experience so I believe there is an issue with custom training?

I have attached a screenshot.. ill be happy to provide other details on a private message if required.

Thanks!

Capture

Azure Computer Vision
Azure Computer Vision
An Azure artificial intelligence service that analyzes content in images and video.
311 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. VasaviLankipalle-MSFT 14,256 Reputation points
    2024-04-17T23:07:21.97+00:00

    Hello @TimboBaggins , Thank you again for your time and patience throughout this issue.

    The product team has identified the issue and worked on the fix. As per 4/22/2024 the PG team has fixed the bug of retry logic of failing job.

    Please let us know if you still face issues. Sorry for the inconveniences.

    I hope you understand.

    Regards,

    Vasavi

    0 comments