How to increase token limit for OpenAI models and what are the limits

Question

I have an enterprise client that is wondering what level of cap we have on the Azure OpenAI LLM . We are currently capped as per your standard setup. What is the setup for requesting a much larger cap for tokens per minute please? And what are the effective tiers? With their client-base we might betaking about 1-5m tokens per minute as a required cap. Most of the time the volume will be a lot lower but that is for peak.

Thanks

Matt

Answer 1

Matt Gosden Welcome to Microsoft Q&A forum!

I have an enterprise client that is wondering what level of cap we have on the Azure OpenAI LLM .We are currently capped as per your standard setup. What is the setup for requesting a much larger cap for tokens per minute please? And what are the effective tiers?

Did you check the Azure OpenAI Service quotas and limits page already?

The following sections provide you with a quick guide to the default quotas and limits that apply to Azure OpenAI:

What is the setup for requesting a much larger cap for tokens per minute please? what are the effective tiers?

Quota increase requests can be submitted from the Quotas page of Azure OpenAI Studio.

Please note that due to overwhelming demand, we are not currently approving new quota increase requests. Your request will be queued until it can be filled at a later time.

For other rate limits, please submit a service request.

Do let me know if that helps or have any other queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further queries do let us know.