Field Detection AI

Kevin Carmody 20

Is it possible to upload a blank form and have the AI detect blank fields and recognize things like check boxes, tables and text fields?

VasaviLankipalle-MSFT 17,021 Reputation points

2024-02-28T00:48:50.7266667+00:00

Hello @Kevin Carmody , we received your feedback that the answer provided on the thread was not helpful.

This is the current limitation for the service. I don't think it extracts line as per your requirement but check box or tables are extracted/ recognized. The supported analysis features or parameters are listed here please refer to this; https://learn.microsoft.com/en-us/azure/ai-services/document-intelligence/overview?view=doc-intel-4.0.0#analysis-features

If there is a data filled it would extract as the key and its value as key-value pair. Right now, it can extract only the key and returns response like this. I have tried with prebuilt layout model with latest preview version.

If you wish, you may re-surveying/rating for the engagement you received on the thread. Your feedback is very important to us.

Looking forward to your reply. Much appreciate your feedback!
VasaviLankipalle-MSFT 17,021 Reputation points

2024-02-29T00:27:19.5966667+00:00

@Kevin Carmody , If you wish, you may re-surveying/rating for the engagement you received on the thread. Your feedback is very important to us.

Looking forward to your reply.

Please remember to "Accept Answer" if any answer/reply helped, so that others in the community facing similar issues can easily find the solution.

Accepted answer

VasaviLankipalle-MSFT 17,021 Reputation points

2024-02-26T21:40:56.93+00:00

Hello @Kevin Carmody , Thanks for using Microsoft Q&A Platform.

Azure AI Document Intelligence can detect some of the fields like check boxes, and tables in a form. This is the current limitation for the service.

I don't think it extracts line as per your requirement but check box or tables are extracted/ recognized. The supported analysis features or parameters are listed here please refer to this; https://learn.microsoft.com/en-us/azure/ai-services/document-intelligence/overview?view=doc-intel-4.0.0#analysis-features

You can use the available pre-built models as per your use-case or train a custom model to recognize the fields and tables.

Here is the example, I have taken the empty application form and used the pre-built layout model:

I hope this helps. Is this something you are looking for?

Regards,

Vasavi

-Please kindly accept the answer and vote 'yes' if you feel helpful to support the community, thanks.
Please sign in to rate this answer.
Kevin Carmody 20 Reputation points

2024-02-27T16:54:23.88+00:00

Sort of... My experience, as well as your example, doesn't recognize the Lines that are on the form. For example, it recognizes the text "First Name", but it doesn't recognize the line after it as a "field". I'm looking for something that will recognize the text ("First Name") as well as the line or "field" next to it and the properties of its length, position, etc.

Kevin Carmody 20 Reputation points

2024-02-27T19:53:25.65+00:00

Kind of.. My needs are to not only recognize the Field text, but the field itself such as the line or the box or the checkbox. Even in your example you only capture the text (ex: "First Name") but not the line or "Form Field" next to it. I hope this makes sense.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Field Detection AI

0 additional answers

Your answer