Service Tier on Azure Open AI resources

Question

Hi, I have an Azure OpenAI resource. We build it up to use it in our daily work. Now we face the problem of rate limits. Our users see a rate limit issue after some inputs in a row. The issue is related to the S0 pricing tier, the resource is configured with.
I really want to provide the usage of this AI in our company. Therefore, I need to extend this limit, so that it is not bothering users any longer.
Unfortunately, I can't change it on the existing resource. OK. But I´m also not able to set it to another value on a new resource.

What to do to overcome this problem?

Thank you very much in advance and kindly regards,

Mathias Siebert

Answer 1

Hi @Siebert, Mathias,

It looks like you're encountering rate limit issues due to the S0 pricing tier on your Azure OpenAI resource. Since rate limits are enforced per minute based on token usage, once the TPM (tokens per minute) threshold is reached, any additional requests within that minute will receive the error.

To Increase your Limits in Azure OpenAI Studio:

1. Check Your Current Quota
   • In Azure OpenAI Studio, go to Shared Resources > Quota and select your subscription from the drop-down.
   • Click the link to Request quota to increase the Quota by filling a form.
2. Request a Higher Limit
   • Since you cannot change the pricing tier of an existing resource, create a new resource and request a higher quota allocation.
3. You could also try increasing the limit on your deployment.

For more details, check: Manage and Increase Quotas in Azure OpenAI Studio.

I hope this helps! Thank you.