How to confirm a form is actually an invoice with analyze invoice (forms recognizer)

Question

How to confirm a form is actually an invoice with analyze invoice (forms recognizer)

SKT 121

Hi

I am using logic apps "Forms Recognizer" with the "Analyze Invoice" version 2.1 action to analyze invoice attachments that are sent to an email address.

It works fine, but sometimes we received emails with attachments that are not invoices.

How can I say:

Analyze Invoice...

If is an invoice, do something

if not an invoice do something else

??

This question would equally apply to Analyze ID or Analyze Business Card etc.

Thanks, sos

Answer 1

MayankBargali-MSFT 52,866

Hi @SKT

Welcome to Microsoft Q&A! Thanks for posting the question.

Based on the response from your action of Form Recognizer you can use create conditional statement that control workflow action in logic app.

Update 7/5:
The Analyze Invoice action returns InvoiceAnalyzeOperationResult which has multiple properties and analyzeResult property is one of the response with this output.
Behind the scene logic app uses the form recognizer API and returns the response. I have tested with the sample input and I don't see any field that can mapped directly for your scenario. There is no functionality to confirm confidence score from the service perspective. For form recognizer perspective it is basically a form where you are training a custom model for a particular form type. It will simply extract fields and provide an output in JSON. The analyze invoice is a prebuilt model to extract certain fields it has been trained on.

Basically if you are receiving fake invoices the processed data from the API should be validated in your application. It is easy to fake a format and send a similar form but your apps needs to validate this.

From logic app perspective there are no connectors that can help in validating fake invoices.

Please feel free to raise a feature request on UserVoice to support it, if this is something that you would want to see in form recognizer.

Feel free to get back to me if you have any queries or concerns.

Please 'Accept as answer' and ‘Upvote’ if it helped so that it can help others in the community looking for help on similar topics.

SKT 121 Reputation points

2021-07-05T08:50:36.907+00:00

Hi thanks for the reply. I'm aware I can use conditional logic, but what condition can I use?

E.g is there a result from the invoice analyzer that says something like "this is an invoice: 90% confidence"
MayankBargali-MSFT 52,866 Reputation points

2021-07-05T09:40:06.253+00:00

@SKT The Analyze Invoice action returns InvoiceAnalyzeOperationResult which has multiple properties and analyzeResult property is one of the response with this output.
Behind the scene logic app uses the form recognizer API and returns the response. I have tested with the sample input and I don't see any field that can mapped directly for your scenario. But I will check with the form recognizer experts to comment if this can be achieved.
MayankBargali-MSFT 52,866 Reputation points

2021-07-05T10:01:49.303+00:00

@SKT I have got the confirmation from form recognizer team that there is no functionality to confirm confidence score from the service perspective. For form recognizer perspective it is basically a form where you are training a custom model for a particular form type. It will simply extract fields and provide an output in JSON. The analyze invoice is a prebuilt model to extract certain fields it has been trained on.

Basically if you are receiving fake invoices the processed data from the API should be validated in your application. It is easy to fake a format and send a similar form but your apps needs to validate this.

From logic app perspective there are no connectors that can help in validating fake invoices.

Please feel free to raise a feature request on UserVoice to support it, if this is something that you would want to see in form recognizer.

Let me know if you have any queries or concerns.
SKT 121 Reputation points

2021-07-06T07:04:20.33+00:00

Thanks Mayank. That answers my question.
MayankBargali-MSFT 52,866 Reputation points

2021-07-06T07:31:58.777+00:00

@SKT Thanks for your response and providing more clarification on your comment. I have updated my answer with our discussion. Feel free to 'Accept as answer' so that it can help others in the community looking for help on similar topics.
SKT 121 Reputation points

2021-07-06T07:49:36.38+00:00

Hi Mayank,

Fake invoices are another problem which is handled by typical business processes such as purchase order numbers.

I'm just trying to avoid trying to process any other random attachments that comes through such as typical spam that seems to end up in the accounts dept mailbox.

It would be great if there was a analyzeResult property that said something like:
If there is a Purchase order, and the text "invoice" exists, and there is a "due date", and an "amount payable" = isInvoice = 80% certain
(or something like that)

I guess I can write it myself, but would be nice if it was there built into the analyze invoice.

Thanks for your digging into this for the community though.
MayankBargali-MSFT 52,866 Reputation points

2021-07-06T08:03:37.947+00:00

@SKT Thanks for your feedback and I will pass your feedback to the form recognizer team. You can also create the feature request so it can be tracked, followed up and others can also vote them if they are looking for the same feature. Product team are continuously monitoring these feedback

How to confirm a form is actually an invoice with analyze invoice (forms recognizer)

0 additional answers

Activity