Field Detection AI

Question

Kevin Carmody 20

Is it possible to upload a blank form and have the AI detect blank fields and recognize things like check boxes, tables and text fields?

Answer accepted by question author

0 additional answers

Answer 1

VasaviLankipalle-MSFT 18,706 Moderator

Hello @Kevin Carmody , Thanks for using Microsoft Q&A Platform.

Azure AI Document Intelligence can detect some of the fields like check boxes, and tables in a form. This is the current limitation for the service.

I don't think it extracts line as per your requirement but check box or tables are extracted/ recognized. The supported analysis features or parameters are listed here please refer to this; https://learn.microsoft.com/en-us/azure/ai-services/document-intelligence/overview?view=doc-intel-4.0.0#analysis-features

You can use the available pre-built models as per your use-case or train a custom model to recognize the fields and tables.

Here is the example, I have taken the empty application form and used the pre-built layout model:

User's image

I hope this helps. Is this something you are looking for?

Regards,

Vasavi

-Please kindly accept the answer and vote 'yes' if you feel helpful to support the community, thanks.

Kevin Carmody 20 Reputation points

2024-02-27T16:54:23.88+00:00

Sort of... My experience, as well as your example, doesn't recognize the Lines that are on the form. For example, it recognizes the text "First Name", but it doesn't recognize the line after it as a "field". I'm looking for something that will recognize the text ("First Name") as well as the line or "field" next to it and the properties of its length, position, etc.
Kevin Carmody 20 Reputation points

2024-02-27T19:53:25.65+00:00

Kind of.. My needs are to not only recognize the Field text, but the field itself such as the line or the box or the checkbox. Even in your example you only capture the text (ex: "First Name") but not the line or "Form Field" next to it. I hope this makes sense.