How to get enough quota in chatai GPT 35 Turbo that can power my day to day chabot.

Adeel Khan 0 Reputation points
2024-07-26T07:58:55.6+00:00

I am currently working on a chatbot project that leverages the capabilities of GPT-3.5 Turbo. This chatbot is intended to be an integral part of our daily operations, providing real-time support and interaction for our users. However, I am facing challenges in ensuring that I have enough quota to maintain the chatbot's performance and availability.

I am encountering this issue during the testing phase, even before deployment. I am on a pay-as-you-go subscription, which typically means you pay based on the usage of resources. Despite this, I am still facing quota limitations and running into "out of quota" issues.

I have also sought help from Microsoft support, but they have kept me waiting for the past five days without resolution.

Can anyone please provide guidance on how to resolve this issue and ensure that I have sufficient quota for my AI chatbot project?

Azure AI Bot Service
Azure AI Bot Service
An Azure service that provides an integrated environment for bot development.
949 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,115 questions
{count} votes

1 answer

Sort by: Most helpful
  1. navba-MSFT 27,550 Reputation points Microsoft Employee Moderator
    2024-07-26T08:14:41.7033333+00:00

    @Adeel Khan Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

    .

    Approach 1:

    Quota increase requests can be submitted from the Quotas page of Azure OpenAI Studio. Note that due to overwhelming demand, quota increase requests are being accepted and will be filled in the order they are received. Priority will be given to customers who generate traffic that consumes the existing quota allocation, and your request might be denied if this condition isn't met.

    Manage Quotas:

    To View and Request quotas, Open the Azure Ai Studio, and get view of your quota allocations across deployments in a given region, select Management > Quota in Azure AI Studio. You can also request for increase quota as shown below by clicking on Request Quota option:

    User's image

    .

    .

    .

    Approach 2:

    Alternatively, You can also use the Dynamic quota which is an Azure OpenAI feature that enables a standard (pay-as-you-go) deployment to opportunistically take advantage of more quota when extra capacity is available.

    User's image

    More info here.

    .

    Hope this helps. If you have any follow-up questions, please let me know. I would be happy to help.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.