About Quota of gpt models

tsuzuki-s 0 Reputation points
2024-05-30T09:30:10.1933333+00:00

I am building a Retrieval-Augmented Generation (RAG) system using various GPT models and text-embedding models on the Azure OpenAI Studio playground.

As I use it, the quota for a specific region has become full, so I have been moving to other regions to continue building the RAG system.

Will this full quota reset after a certain period of time, or once it is full, do I have to add more quota to continue using it?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,416 questions
{count} votes

1 answer

Sort by: Most helpful
  1. AshokPeddakotla-MSFT 29,571 Reputation points
    2024-05-30T10:21:05.1166667+00:00

    tsuzuki-s Greetings & Welcome to Microsoft Q&A forum!

    Will this full quota reset after a certain period of time, or once it is full, do I have to add more quota to continue using it?

    If you have reached the quota limit for a specific region, you can continue using the service by deploying your resources to another region. However, the quota limit for a specific region will not reset after a certain period of time. If you need to increase the quota limit for a specific region, you can apply for a quota increase.

    Quota increase requests can be submitted from the Quotas page of Azure OpenAI Studio. Please note that due to overwhelming demand, quota increase requests are being accepted and will be filled in the order they are received. Priority will be given to customers who generate traffic that consumes the existing quota allocation, and your request may be denied if this condition isn't met.

    For other rate limits, please submit a service request.

    For your scenario, I suggest explore Azure OpenAI Dynamic quota. Dynamic quota is an Azure OpenAI feature that enables a standard (pay-as-you-go) deployment to opportunistically take advantage of more quota when extra capacity is available.

    I hope this helps. Do let me know if you have any further queries.

    1 person found this answer helpful.
    0 comments No comments