How to get Form Recognizer for Receipts to return Payment Method

Fredrik Tingdal 1 Reputation point
2022-02-12T16:54:02.353+00:00

Most receipts include a payment method. This payment method is very useful when automating receipt processing and integration with accounting systems (Even though for credit cards it is often truncated). It does not appear to be one of the standard fields on template. Can I teach it to extract this additional field?

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,578 questions
0 comments

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. YutongTie-MSFT 46,986 Reputation points
    2022-02-14T18:27:12.077+00:00

    @Fredrik Tingdal

    Thanks for reaching out to us. I think you are referring to Form Recognizer Custom Model function.

    You can add your receipts (at least 5) to do the custom training, you need to label what you want to extract so that the model can read it next time.

    By using custom models, you can analyze and extract data from forms and documents specific to your business. Custom models are trained for your distinct data and use cases. A custom model is a machine-learning program trained to recognize form fields within your distinct content and extract key-value pairs and table data. You only need five examples of the same form type to get started and your custom model can be trained with or without labeled datasets.
    analyze-custom.png
    You can either do by Studio or Labelling tool.

    A quick guidance is here: https://learn.microsoft.com/en-us/azure/applied-ai-services/form-recognizer/quickstarts/try-v3-form-recognizer-studio#getting-started

    Hope this helps!

    Regards,
    Yutong

    -Please kindly accept the answer if you feel this is helpful, thanks.

  2. Fredrik Tingdal 1 Reputation point
    2023-01-20T18:53:59.4966667+00:00

    The custom model is struggling with other receipt concepts such as 'tip', written in hand writing. I don't really feel like training a new model when you already have a pre-built model for receipts. I was surprised that this pre-built model does not account for payment method, but instead assumes all receipts are paid for in cash (look at the examples in form recognizer - they have not concept of payment method).

    Payment method (e.g. CASH, VISA, AMEX, Gift Card) is on almost all receipts these days, and your standard model for receipts should pull it out. So, I guess, I'm requesting an enhancement to make this happen?

    0 comments