Confidence value for table fields

Question

Confidence value for table fields

az 71

Hello. Is it possible to get confidence value for table type fields returned by form recognizer analyze call? For now we can get confidence value for regular key/value fields only.
Is it planned to add this feature in next releases?

romungi-MSFT 49,096 Reputation points Microsoft Employee Moderator

2021-11-29T08:30:33.473+00:00

@az As per the current version of the API we do not see a confidence score returned for tables. We will pass this feedback to the team to check if this is planned for future releases.
Also, the layout API provides tables section in the response if a table is identified. Does this identification help in the response?
az 71 Reputation points

2022-01-26T11:29:51.617+00:00

@romungi-MSFT Have you received any feedback from development team about this feature?
Table data returned by layout API is something different that confidence value returned for recognized field, we can try to use this information, but it will not solve our problem.
Our goal is to check if we can relay on fields returned by recognize API, we cant do this without confidence value returned for all recognized fields (that mens for table type too).
Michael Aldworth 0 Reputation points

2023-02-21T15:08:47.2466667+00:00

@romungi-MSFT

This document page https://learn.microsoft.com/en-us/azure/applied-ai-services/form-recognizer/concept-accuracy-confidence?view=form-recog-3.0.0 has a note at the top, that says structured data (tables) does currently not have accuracy scores.

We need to have the confidence score for each row retrieved in the table. Do you know if the team is actively working on this becoming available? Because until we get this, we unfortunately the product is unusable for our specific use case.
Peter Benschop 0 Reputation points

2023-03-11T20:49:30.9966667+00:00

Since the cell contents are also found in the "Words" section of the recognition results (which does provide a confidence for each word), would looking up the table cell contents (which may consist of multiple words) in the "Words" section to get a confidence, be an acceptable workaround until a future version of the Form Recognizer provides a confidence for table cells?
Gurpreet Chawla 0 Reputation points

2024-03-06T21:52:06.8233333+00:00

A confidence score for tables can have a cell/row/column wise confidence & since the words are just OCR confidence that isn't that useful for that use case.
Peter Benschop 0 Reputation points

2024-03-07T19:16:36.1633333+00:00

Thanks, Gurpreet. To better understand your response, could you please elaborate on the difference between OCR confidence and the Document Intelligence confidence? Maybe provide an example? Maybe I missed that but I have not seen an explanation of that difference in the documentation.
Pankaj Singh Negi 20 Reputation points

2024-12-24T12:08:51.0033333+00:00

I believe, Confidence scores are now available for tables, table rows, and table cells with 2024-11-30 (GA) API version for custom models. Please see documentation. https://learn.microsoft.com/en-us/azure/ai-services/document-intelligence/concept/accuracy-confidence?view=doc-intel-4.0.0

1 answer

Your answer

romungi-MSFT 49,096 Reputation points Microsoft Employee Moderator

2021-11-29T08:30:33.473+00:00

@az As per the current version of the API we do not see a confidence score returned for tables. We will pass this feedback to the team to check if this is planned for future releases.
Also, the layout API provides tables section in the response if a table is identified. Does this identification help in the response?
az 71 Reputation points

2022-01-26T11:29:51.617+00:00

@romungi-MSFT Have you received any feedback from development team about this feature?
Table data returned by layout API is something different that confidence value returned for recognized field, we can try to use this information, but it will not solve our problem.
Our goal is to check if we can relay on fields returned by recognize API, we cant do this without confidence value returned for all recognized fields (that mens for table type too).
Michael Aldworth 0 Reputation points

2023-02-21T15:08:47.2466667+00:00

@romungi-MSFT

This document page https://learn.microsoft.com/en-us/azure/applied-ai-services/form-recognizer/concept-accuracy-confidence?view=form-recog-3.0.0 has a note at the top, that says structured data (tables) does currently not have accuracy scores.

We need to have the confidence score for each row retrieved in the table. Do you know if the team is actively working on this becoming available? Because until we get this, we unfortunately the product is unusable for our specific use case.
Peter Benschop 0 Reputation points

2023-03-11T20:49:30.9966667+00:00

Since the cell contents are also found in the "Words" section of the recognition results (which does provide a confidence for each word), would looking up the table cell contents (which may consist of multiple words) in the "Words" section to get a confidence, be an acceptable workaround until a future version of the Form Recognizer provides a confidence for table cells?
Gurpreet Chawla 0 Reputation points

2024-03-06T21:52:06.8233333+00:00

A confidence score for tables can have a cell/row/column wise confidence & since the words are just OCR confidence that isn't that useful for that use case.
Peter Benschop 0 Reputation points

2024-03-07T19:16:36.1633333+00:00

Thanks, Gurpreet. To better understand your response, could you please elaborate on the difference between OCR confidence and the Document Intelligence confidence? Maybe provide an example? Maybe I missed that but I have not seen an explanation of that difference in the documentation.
Pankaj Singh Negi 20 Reputation points

2024-12-24T12:08:51.0033333+00:00

I believe, Confidence scores are now available for tables, table rows, and table cells with 2024-11-30 (GA) API version for custom models. Please see documentation. https://learn.microsoft.com/en-us/azure/ai-services/document-intelligence/concept/accuracy-confidence?view=doc-intel-4.0.0

Answer 1

Balbir Singh 0

Are there any updates on this and a timeline for when confidence scores will be supported for structured fields such as tables?

Also, do we have an optimal pseudo code to generate the confidence level by comparing this to the "Words" section.

Niket Kumar Singh 835 Reputation points

2024-07-08T05:29:07.04+00:00

Share via

Confidence value for table fields

1 answer

Your answer