Best practices for operating Azure Form Recognizer endpoints

ryota.matsuda 140 Reputation points
2023-05-29T10:33:53.7866667+00:00

I am considering embedding endpoints and keys in the application to make it an application. In this case, an unspecified number of users may access one endpoint.

Will the server go down easily in this case? Or does the endpoint have an auto-scaling feature and only one endpoint needs to be accessed? Or

Is it better to operate one endpoint per customer?

This one has been confirmed.
https://learn.microsoft.com/ja-jp/azure/applied-ai-services/form-recognizer/faq?view=form-recog-3.0.0#-------------------------------------

Azure AI Document Intelligence
Azure AI Document Intelligence
An Azure service that turns documents into usable data. Previously known as Azure Form Recognizer.
1,527 questions
{count} votes

Accepted answer
  1. romungi-MSFT 43,686 Reputation points Microsoft Employee
    2023-05-30T08:58:01.1633333+00:00

    @ryota.matsuda If you are planning to create an application that requires customers to create a FR resource in their subscription and then update the endpoint details in your application then every customer has control over their FR resource TPS limits. This means that customer uses the application within limits and if there is any gradual increase in TPS the service will handle this using the autoscaling features of cognitive services. However, any abnormal increase in TPS will cause throttling and can result in error 429. If these errors are persistent, it is better to increase the TPS limits of a resource by raising a support case to update the limits. The service limits page has details on how this can be handled.

    If you have a single hosted version of your application, then a single endpoint will have an utmost maximum limit that it can scale to depending on your use case presented to the service team through support case. So, this might cause some limitations in the future with respect to capacity and will also require additional tracking for billing to bill each of your customer based on the requests they make. I hope this helps!!

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful