Is there daily or month quota cap for text-embedding-ada-002

Question

I am getting below error.

Requests to the Embeddings_Create Operation under Azure OpenAI API version 2024-08-01-preview have exceeded call rate limit of your current OpenAI S0 pricing tier. Please retry after 1 second.
Please go here: https://aka.ms/oai/quotaincrease if you would like to further increase the default rate limit. For Free Account customers, upgrade to Pay as you Go here: https://aka.ms/429TrialUpgrade.

Is there daily or month quota cap for text-embedding-ada-002 beside TPM and RPM?

Answer 1

The effective embedding model deployment limits are applied to individual deployments - you can easily identify these from Azure OpenAI Service/Azure AI Foundry interface. The bottom line is that all of them are per minute - none of them apply on per day/month level

---

If the above response helps answer your question, remember to "Accept Answer" so that others in the community facing similar issues can easily find the solution. Your contribution is highly appreciated.

hth

Marcin

Answer 2

Hi Anjan Shakya

I could find one more limit in quota and limit docs beside TPM and RPM.

Max number or inputs in array with /embeddings- 2048

But TPM decides how many requests you can send in 1 minute. (RPM), It is expected to throw a rate limit error any time it crosses per second limit for all Azure OpenAI models to constrain regional demands and keep servers healthy.

1. You may increase your TPM on the embedding model from deployment section to avail higher rate limits
2. Adopt backup-exponential retry logic with dynamic sleep time

Hope it addresses your query.

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

Thank You.