Service quotas and limits

This content applies to: v4.0 (preview) | Previous versions: v3.1 (GA) v3.0 (GA)

This article contains both a quick reference and detailed description of Azure AI Document Intelligence service Quotas and Limits for all pricing tiers. It also contains some best practices to avoid request throttling.

Model usage

Document types supported	Read	Layout	Prebuilt models	Custom models
PDF	✔️	✔️	✔️	✔️
Images (JPEG/JPG), PNG, BMP, TIFF, HEIF	✔️	✔️	✔️	✔️
Office file types DOCX, PPTX, XLS	✔️	✔️	✖️	✖️

• Document Intelligence SDKs
• Document Intelligence REST API
• Document Intelligence Studio v3.0

Quota	Free (F0)1	Standard (S0)
Transactions Per Second limit	1	15 (default value)
Adjustable	No	Yes 2
Max document size	4 MB	500 MB
Adjustable	No	No
Max number of pages (Analysis)	2	2000
Adjustable	No	No
Max size of labels file	10 MB	10 MB
Adjustable	No	No
Max size of OCR json response	500 MB	500 MB
Adjustable	No	No
Max number of Template models	500	5000
Adjustable	No	No
Max number of Neural models	100	500
Adjustable	No	No

Custom model usage

• Custom template model
• Custom neural model
• Composed classification models
• Composed custom models

Quota	Free (F0) 1	Standard (S0)
Compose Model limit	5	200 (default value)
Adjustable	No	No
Training dataset size * Neural	1 GB 3	1 GB (default value)
Adjustable	No	No
Training dataset size * Template	50 MB 4	50 MB (default value)
Adjustable	No	No
Max number of pages (Training) * Template	500	500 (default value)
Adjustable	No	No
Max number of pages (Training) * Neural	50,000	50,000 (default value)
Adjustable	No	No
Custom neural model train	10 per month	20 per month
Adjustable	No	Yes 3
Max number of pages (Training) * Classifier	10,000	10,000 (default value)
Adjustable	No	No
Max number of document types (classes) * Classifier	500	500 (default value)
Adjustable	No	No
Training dataset size * Classifier	1GB	1GB (default value)
Adjustable	No	No
Min number of samples per class * Classifier	5	5 (default value)
Adjustable	No	No

¹ For Free (F0) pricing tier see also monthly allowances at the pricing page.
² See best practices, and [adjustment instructions(#create-and-submit-support-request).
³ Neural models training count is reset every calendar month. Open a support request to increase the monthly training limit.

⁴ This limit applies to all documents found in your training dataset folder prior to any labeling-related updates.

Detailed description, Quota adjustment, and best practices

Before requesting a quota increase (where applicable), ensure that it's necessary. Document Intelligence service uses autoscaling to bring the required computational resources in "on-demand" and at the same time to keep the customer costs low, deprovision unused resources by not maintaining an excessive amount of hardware capacity.

If your application returns Response Code 429 (Too many requests) and your workload is within the defined limits: most likely, the service is scaling up to your demand, but has yet to reach the required scale. Thus the service doesn't immediately have enough resources to serve the request. This state is transient and shouldn't last long.

General best practices to mitigate throttling during autoscaling

To minimize issues related to throttling (Response Code 429), we recommend using the following techniques:

• Implement retry logic in your application
• Avoid sharp changes in the workload. Increase the workload gradually
  Example. Your application is using Document Intelligence and your current workload is 10 TPS (transactions per second). The next second you increase the load to 40 TPS (that is four times more). The Service immediately starts scaling up to fulfill the new load, but likely it can't do it within a second, so some of the requests get Response Code 429.

The next sections describe specific cases of adjusting quotas. Jump to Document Intelligence: increasing concurrent request limit

Increasing transactions per second request limit

By default the number of transactions per second is limited to 15 transactions per second for a Document Intelligence resource. For the Standard pricing tier, this amount can be increased. Before submitting the request, ensure you're familiar with the material in this section and aware of these best practices.

Increasing the Concurrent Request limit does not directly affect your costs. Document Intelligence service uses "Pay only for what you use" model. The limit defines how high the Service can scale before it starts throttle your requests.

Existing value of Concurrent Request limit parameter is not visible via Azure portal, Command-Line tools, or API requests. To verify the existing value, create an Azure Support Request.

If you would like to increase your transactions per second, you can enable auto scaling on your resource. Follow this document to enable auto scaling on your resource * enable auto scaling. You can also submit an increase TPS support request.

Have the required information ready

• Document Intelligence Resource ID

• Region

• How to get information (Base model):

  • Sign in to the Azure portal
  • Select the Document Intelligence Resource for which you would like to increase the transaction limit
  • Select Properties (Resource Management group)
  • Copy and save the values of the following fields:
    • Resource ID
    • Location (your endpoint Region)

Create and submit support request

Initiate the increase of transactions per second(TPS) limit for your resource by submitting the Support Request:

• Ensure you have the required information
• Sign in to the Azure portal
• Select the Document Intelligence Resource for which you would like to increase the TPS limit
• Select New support request (Support + troubleshooting group)
• A new window appears with autopopulated information about your Azure Subscription and Azure Resource
• Enter Summary (like "Increase Document Intelligence TPS limit")
• In Problem type,* select "Quota or usage validation"
• Select Next: Solutions
• Proceed further with the request creation
• Under the Details tab, enter the following information in the Description field:
  • a note, that the request is about Document Intelligence quota.
  • Provide a TPS expectation you would like to scale to meet.
  • Azure resource information you collected.
  • Complete entering the required information and select Create button in Review + create tab
  • Note the support request number in Azure portal notifications. You're contacted shortly for further processing

Example of a workload pattern best practice

This example presents the approach we recommend following to mitigate possible request throttling due to Autoscaling being in progress. It isn't an exact recipe, but merely a template we invite to follow and adjust as necessary.

Let us suppose that a Document Intelligence resource has the default limit set. Start the workload to submit your analyze requests. If you find that you're seeing frequent throttling with response code 429, start by implementing an exponential backoff on the GET analyze response request. By using a progressively longer wait time between retries for consecutive error responses, for example a 2-5-13-34 pattern of delays between requests. In general, we recommended not calling the get analyze response more than once every 2 seconds for a corresponding POST request.

If you find that you're being throttled on the number of POST requests for documents being submitted, consider adding a delay between the requests. If your workload requires a higher degree of concurrent processing, you then need to create a support request to increase your service limits on transactions per second.

Generally, we recommended testing the workload and the workload patterns before going to production.

Next steps

Learn about error codes and troubleshooting