Events
Take the Microsoft Learn Challenge
Nov 19, 11 PM - Jan 10, 11 PM
Ignite Edition - Build skills in Microsoft Azure and earn a digital badge by January 10!
Register nowThis browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
This content applies to: v2.1 | Latest version: v4.0 (GA)
Azure AI Document Intelligence is a cloud-based Azure AI service that enables you to build intelligent document processing solutions. Massive amounts of data, spanning a wide variety of data types, are stored in forms and documents. Document Intelligence enables you to effectively manage the velocity at which data is collected and processed and is key to improved operations, informed data-driven decisions, and enlightened innovation.
| ✔️ Document analysis models | ✔️ Prebuilt models | ✔️ Custom models |
General extraction models enable text extraction from forms and documents and return structured business-ready content ready for your organization's action, use, or development.
Read | Extract printed
and handwritten text.
Layout | Extract text, tables,
and document structure.
General document | Extract text,
structure, and key-value pairs.
Prebuilt models enable you to add intelligent document processing to your apps and flows without having to train and build your own models.
Bank Statement | Extract account information and details from bank statements.
Check | Extract relevant information from checks.
Contract | Extract agreement and party details.
Credit card | Extract payment card information.
Invoice | Extract customer and vendor details.
Pay Stub | Extract pay stub details.
Receipt | Extract sales transaction details.
Unified US tax | Extract from any US tax forms supported.
US Tax W-2 | Extract taxable compensation details.
US Tax 1098 | Extract 1098
variation details.
US Tax 1099 | Extract 1099
variation details.
US Tax 1040 | Extract 1040
variation details.
US mortgage 1003 | Extract loan application details.
US mortgage 1004 | Extract information from appraisal.
US mortgage 1005 | Extract information from validation of employment.
US mortgage 1008 | Extract loan transmittal details.
US mortgage disclosure | Extract final closing loan terms.
Health Insurance card | Extract insurance coverage details.
Identity | Extract verification details.
Marriage certificate | Extract certified marriage information.
Invoice | Extract customer
and vendor details.
Receipt | Extract sales
transaction details.
Identity | Extract identification
and verification details.
Health Insurance card | Extract health insurance details.
Business card | Extract business contact details.
Contract | Extract agreement
and party details.
US Tax W-2 | Extract taxable
compensation details.
US Tax 1098 | Extract 1098
variation details.
Custom models are trained using your labeled datasets to extract distinct data from forms and documents, specific to your use cases. Standalone custom models can be combined to create composed models.
✔️ Document field extraction models are trained to extract labeled fields from documents.
Custom neural | Extract data from mixed-type documents.
Custom template | Extract data from static layouts.
Custom composed | Extract data using a collection of models.
✔️ Custom classifiers identify document types before invoking an extraction model.
Custom classifier | Identify designated document types (classes) before invoking an extraction model.
Document Intelligence supports optional features that can be enabled and disabled depending on the document extraction scenario:
Model ID | Content Extraction | Query fields | Paragraphs | Paragraph Roles | Selection Marks | Tables | Key-Value Pairs | Languages | Barcodes | Document Analysis | Formulas* | Style Font* | High Resolution* | Searchable PDF |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
prebuilt-read | ✓ | ✓ | O | O | O | O | O | O | ||||||
prebuilt-layout | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | O | O | O | O | O | O | ||
prebuilt-contract | ✓ | ✓ | ✓ | ✓ | ✓ | O | O | ✓ | O | O | ||||
prebuilt-healthInsuranceCard.us | ✓ | ✓ | O | O | ✓ | O | O | O | ||||||
prebuilt-idDocument | ✓ | ✓ | O | O | ✓ | O | O | O | ||||||
prebuilt-invoice | ✓ | ✓ | ✓ | ✓ | O | O | O | ✓ | O | O | O | |||
prebuilt-receipt | ✓ | ✓ | O | O | ✓ | O | O | O | ||||||
prebuilt-marriageCertificate.us | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O | |||||
prebuilt-creditCard | ✓ | ✓ | O | O | ✓ | O | O | O | ||||||
prebuilt-check.us | ✓ | ✓ | O | O | ✓ | O | O | O | ||||||
prebuilt-payStub.us | ✓ | ✓ | O | O | ✓ | O | O | O | ||||||
prebuilt-bankStatement | ✓ | ✓ | O | O | ✓ | O | O | O | ||||||
prebuilt-mortgage.us.1003 | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O | |||||
prebuilt-mortgage.us.1004 | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O | |||||
prebuilt-mortgage.us.1005 | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O | |||||
prebuilt-mortgage.us.1008 | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O | |||||
prebuilt-mortgage.us.closingDisclosure | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O | |||||
prebuilt-tax.us | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O | |||||
prebuilt-tax.us.w2 | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O | |||||
prebuilt-tax.us.w4 | ✓ | ✓ | O | O | ✓ | O | O | O | ||||||
prebuilt-tax.us.1040 (various) | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O | |||||
prebuilt-tax.us.1095A | ✓ | ✓ | O | O | ✓ | O | O | O | ||||||
prebuilt-tax.us.1095C | ✓ | ✓ | O | O | ✓ | O | O | O | ||||||
prebuilt-tax.us.1098 | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O | |||||
prebuilt-tax.us.1098E | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O | |||||
prebuilt-tax.us.1098T | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O | |||||
prebuilt-tax.us.1099 (various) | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O | |||||
prebuilt-tax.us.1099SSA | ✓ | ✓ | O | O | ✓ | O | O | O | ||||||
{ customModelName } | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | O | O | ✓ | O | O | O |
✓ - Enabled
O - Optional
* - Premium features incur extra costs
Note
The following document understanding models and development options are supported by the Document Intelligence service v3.0.
You can use Document Intelligence to automate document processing in applications and workflows, enhance data-driven strategies, and enrich document search capabilities. Use the links in the table to learn more about each model and browse development options.
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-read | ● Extract text from documents. ● Data extraction |
● Digitizing any document. ● Compliance and auditing. ● Processing handwritten notes before translation. |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-layout | ● Extract text and layout information from documents. ● Data extraction |
● Document indexing and retrieval by structure. ● Financial and medical report analysis. |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-document | ● Extract text,layout, and key-value pairs from documents. ● Data and field extraction |
● Key-value pair extraction. ● Form processing. ● Survey data collection and analysis. |
● Document Intelligence Studio ● REST API |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-invoice | ● Extract key information from invoices. ● Data and field extraction |
● Accounts payable processing. ● Automated tax recording and reporting. |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-receipt | ● Extract key information from receipts. ● Data and field extraction ● Receipt model v3.0 supports processing of single-page hotel receipts. |
● Expense management. ● Consumer behavior data analysis. ● Customer loyalty program. ● Merchandise return processing. ● Automated tax recording and reporting. |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-idDocument | ● Extract key information from passports and ID cards. ● Document types ● Extract endorsements, restrictions, and vehicle classifications from US driver's licenses. |
● Know your customer (KYC) financial services guidelines compliance. ● Medical account management. ● Identity checkpoints and gateways. ● Hotel registration. |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-check | ● Extract key information from checks. ● Data and field extraction |
● Credit management. ● Automated lender management. |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-paystub | ● Extract key information from pay stubs. ● Data and field extraction |
● Employee payroll detail verification. ● Fraud detection for employment. ● Automated tax processing. |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-bankStatement | ● Extract key information from bank statements. ● Data and field extraction |
● Tax Processing use cases. ● Automated accounting management. ● Credit-debit management. ● Loan documentation processing. |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-healthInsuranceCard.us | ● Extract key information from US health insurance cards. ● Data and field extraction |
● Coverage and eligibility verification. ● Predictive modeling. ● Value-based analytics. |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Development options |
---|---|---|
prebuilt-contract | Extract contract agreement and party details. ● Data and field extraction |
● Document Intelligence Studio ● REST API ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Development options |
---|---|---|
prebuilt-creditCard | Extract contract agreement and party details. ● Data and field extraction |
● Document Intelligence Studio ● REST API ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Development options |
---|---|---|
prebuilt-marriageCertificate.us | Extract contract agreement and party details. ● Data and field extraction |
● Document Intelligence Studio ● REST API ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-mortgage.us.1003 | ● Extract key information from 1003 loan applications. ● Data and field extraction |
● Fannie Mae and Freddie Mac documentation requirements. | ● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-mortgage.us.1004 | ● Extract key information from 1004 appraisals. ● Data and field extraction |
● Fannie Mae and Freddie Mac documentation requirements. ● Uniform Residential Appraisal report to help lender/client with the market value of the subject property. |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-mortgage.us.1005 | ● Extract key information from 1005 validation of employment. ● Data and field extraction |
● Fannie Mae and Freddie Mac documentation requirements. ● Verification of employment document to determine the qualification as a prospective mortgagor. |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-mortgage.us.1008 | ● Extract key information from Uniform Underwriting and Transmittal Summary. ● Data and field extraction |
● Loan underwriting processing using summary data. | ● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-mortgage.us.closingDisclosure | ● Extract key information from Uniform Underwriting and Transmittal Summary. ● Data and field extraction |
● Mortgage loan final details requirements. | ● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-tax.us.W-2 | ● Extract key information from IRS US W2 tax forms (year 2018-2021). ● |
● Automated tax document management. ● Mortgage loan application processing. |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Development options |
---|---|---|
prebuilt-tax.us.1098{variation } |
● Extract key information from 1098-form variations. ● |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Development options |
---|---|---|
prebuilt-tax.us.1099{variation } |
● Extract information from 1099-form variations. ● |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Development options |
---|---|---|
prebuilt-tax.us.1040{variation } |
● Extract information from 1040-form variations. ● |
● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Development options |
---|---|---|
prebuilt-tax.us | ●Extract information from any of the supported US tax forms. | ● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
Model ID | Description | Automation use cases | Development options |
---|---|---|---|
prebuilt-businessCard | ● Extract key information from business cards. ● Data and field extraction |
● Sales lead and marketing management. | ● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript |
About | Description | Automation use cases | Development options |
---|---|---|---|
Custom model | Extracts information from forms and documents into structured data based on a model created from a set of representative training document sets. | Extract distinct data from forms and documents specific to your business and use cases. | ● Document Intelligence Studio ● REST API ● C# SDK ● Java SDK ● JavaScript SDK ● Python SDK |
Note
To train a custom neural model, set the buildMode
property to neural
.
For more information, see Training a neural model
About | Description | Automation use cases | Development options |
---|---|---|---|
Custom Neural model | The custom neural model is used to extract labeled data from structured (surveys, questionnaires), semi-structured (invoices, purchase orders), and unstructured documents (contracts, letters). | Extract text data, checkboxes, and tabular fields from structured and unstructured documents. | Document Intelligence Studio ● REST API ● C# SDK ● Java SDK ● JavaScript SDK ● Python SDK |
Note
To train a custom template model, set the buildMode
property to template
.
For more information, see Training a template model
About | Description | Automation use cases | Development options |
---|---|---|---|
Custom Template model | The custom template model extracts labeled values and fields from structured and semi-structured documents. |
Extract key data from highly structured documents with defined visual templates or common visual layouts, forms. | ● Document Intelligence Studio ● REST API ● C# SDK ● Python SDK ● Java SDK ● JavaScript SDK |
About | Description | Automation use cases | Development options |
---|---|---|---|
Composed custom models | A composed model is created by taking a collection of custom models and assigning them to a single model built from your form types. | Useful when you train several models and want to group them to analyze similar form types like purchase orders. | ● Document Intelligence Studio ● REST API ● C# SDK ● Java SDK ● JavaScript SDK ● Python SDK |
About | Description | Automation use cases | Development options |
---|---|---|---|
Composed classification model | Custom classification models combine layout and language features to detect, identify, and classify documents within an input file. | ● A loan application packaged containing application form, payslip, and, bank statement. ● A collection of scanned invoices. |
● Document Intelligence Studio ● REST API |
Azure AI Document Intelligence is a cloud-based Azure AI service for developers to build intelligent document processing solutions. Document Intelligence applies machine-learning-based optical character recognition (OCR) and document understanding technologies to extract text, tables, structure, and key-value pairs from documents. You can also label and train custom models to automate data extraction from structured, semi-structured, and unstructured documents. To learn more about each model, see the Concepts articles:
Model type | Model name |
---|---|
Document analysis model | ● Layout analysis model |
Prebuilt models | ● Invoice model ● Receipt model ● Identity document (ID) model ● Business card model |
Custom models | ● Custom model ● Composed model |
This content applies to: v2.1 | Latest version: v4.0 (GA)
Tip
Note
The following models and development options are supported by the Document Intelligence service v2.1.
Use the links in the table to learn more about each model and browse the API references:
As with all AI services, developers using the Document Intelligence service should be aware of Microsoft policies on customer data. See our Data, privacy, and security for Document Intelligence page.
Try processing your own forms and documents with the Document Intelligence Studio.
Complete a Document Intelligence quickstart and get started creating a document processing app in the development language of your choice.
Try processing your own forms and documents with the Document Intelligence Sample Labeling tool.
Complete a Document Intelligence quickstart and get started creating a document processing app in the development language of your choice.
Events
Take the Microsoft Learn Challenge
Nov 19, 11 PM - Jan 10, 11 PM
Ignite Edition - Build skills in Microsoft Azure and earn a digital badge by January 10!
Register nowTraining
Module
Extract data from forms with Azure Document intelligence - Training
Azure Document intelligence extracts data at scale to enable the submission of documents in real time, at scale, with accuracy. This module gives users the tools to use the Azure Document intelligence vision API.
Certification
Microsoft Certified: Power Automate RPA Developer Associate - Certifications
Demonstrate how to improve and automate workflows with Microsoft Power Automate RPA developer.