READ OCR Bounding Box Accuracy

Baruch Shadrouz 31 Reputation points
2021-03-08T15:59:38.083+00:00

I am using the basic Code for the READ OCR that Microsoft gives in their getting started guide. The only modification is that I am running that program with multiprocessing with 4 cores so I am making multiple calls to the API at the same time.

The READ OCR sometimes gives me a Bounding Box of a word that is either too large or too small for that word. You can see in the screenshot below that the word "40.00" was completely found but the bounding box is too small and does not cover the entire word. The same issue happens with the word "Current". There is cases where the bounding box is too large as well.
75542-image.png

Any help would be appreciated!

Computer Vision
Computer Vision
An Azure artificial intelligence service that analyzes content in images and video.
416 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
3,619 questions
{count} vote

6 answers

Sort by: Most helpful
  1. Mitchell 11 Reputation points
    2022-08-01T11:26:15.517+00:00

    I have found the same as well, the below image shows Tesseract bounding boxes in Blue and Azure Read API bounding boxes in Red. Almost every bounding box from azure is taller than the actual text and nearly all shifted to the left slightly.

    Is there any update for a fix to this issue? @GiftA-MSFT

    226665-azure-vs-tesseract.png

    2 people found this answer helpful.
    0 comments No comments

  2. cr 6 Reputation points
    2022-12-03T08:20:36.987+00:00

    I am struggling with the same problem as @Mitchell . Bounding boxes are inaccurate and often shifted to the left.
    Is there any progress on this? Can we expect this problem to be fixed at some point? @GiftA-MSFT
    As my use case is depending on exact bounding boxes, I'd need to find another solution if fixing this is not on the roadmap.

    Thanks!

    1 person found this answer helpful.
    0 comments No comments

  3. Eike Thies 5 Reputation points
    2024-09-11T12:11:14.76+00:00

    it is 2024 and this problem is still there. we have it on thousands of documents. what is even more strange is that in the document intelligence studio on hover you can see the correct values displayed. it also correctly highlights the words. but the results in the json via api or in the "result" tab in studio are slightly off

    grafik

    1 person found this answer helpful.
    0 comments No comments

  4. dj-ancora 1 Reputation point
    2023-01-03T00:43:16.48+00:00

    I too am have the same problem with the bounding boxes often being too spacious on the left/top/bottom sides and not properly encompassing the text on the right side.

    0 comments No comments

  5. Anonymous
    2024-04-26T07:23:28.19+00:00

    I also have same problem. in most of documents 1, D and 5 is extracting wrong.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.