Rate limit exceeded

Don Costanzo 5

I have waited three days and i am still getting this error - Error Server responded with status 429. Error message: {'error': {'code': '429', 'message': 'Rate limit is exceeded. Try again in 86400 seconds.'}}

PRADEEPCHEEKATLA-MSFT 90,226 Reputation points Microsoft Employee

2024-07-01T03:51:42.26+00:00

@Don Costanzo - Thanks for the question and using MS Q&A platform.

Could you please help me with the Azure service area which you are trying?
Don Costanzo 5 Reputation points

2024-07-01T10:57:31.1266667+00:00

Azure AI services
romungi-MSFT 46,831 Reputation points Microsoft Employee

2024-07-03T10:25:27.86+00:00

@Don Costanzo Did the above guidance help to check if 429 error can be avoided?

1 answer

romungi-MSFT 46,831 Reputation points Microsoft Employee

2024-07-02T05:59:40.3866667+00:00

@Don Costanzo 429 error code indicates that the rate of requests sent to the API exceeds the safe threshold limit. In most cases, the Tranactions per second(TPS) value is hit and you will see this message. Depending on the AI service and API you are using, there could be an option to increase the TPS limits from quota limits page of the service or request a higher TPS by raising a support case from Azure portal.

If you have created your service or resource with free tier, try changing that to a higher or standard tier and then retry the scenario. In most cases, this is the cause of the message.

Also, please note that the services are designer to scale up as per demand and if you see the same error while increasing the workload try to avoid sharp increase in workload, some of the best practices for these scenarios are also documented in the respective service limits documentation. For example, for speech services you can look up the guidance here.
Please sign in to rate this answer.

1 person found this answer helpful.
Omar Ayoub 0 Reputation points

2024-09-12T08:29:16.25+00:00

i was just trying to test the (gpt4o-mini) in the playground , i just send 'Hi' message and i got this eror:
rate_limit_exceeded: Rate limit is exceeded. Try again in 86400 seconds. RunId:****

Redar Ismail Chicho 1 Reputation point

2024-10-10T18:23:04.5+00:00

I am training to learn Azure AI Studio and have encountered a frustrating error: "Server responded with status 429. Error message: {'error': {'code': '429', 'message': 'Rate limit is exceeded. Try again in 59 seconds.'}}" This error occurs specifically when I add my dataset to the model inside the Add your data tab . My data has been uploaded and indexed successfully. I have deployed the GPT-4.0 mini model with a rate limit of 8,000 tokens per minute. Additionally, the text-embedding-ada-002 model has been automatically deployed, and I increased its rate limit to 240,000 tokens per minute. While my chat playground functions correctly, I consistently face this error when I add my data. Sometimes, it works briefly when I provide a first prompt, but it quickly reverts to the error message, "residing at 890 Lake Street." Could you please help me understand how to resolve this issue?

Redar Ismail Chicho 1 Reputation point

2024-10-10T18:26:34.33+00:00

I am currently training to learn Azure AI Studio and have been encountering a frustrating error: "Server responded with status 429. Error message: {'error': {'code': '429', 'message': 'Rate limit is exceeded. Try again in 59 seconds.'}}" This error occurs specifically when I add a datastore and then attempt to index it. My data has been uploaded and indexed successfully. I have deployed the GPT-4.0 mini model with a rate limit of 8,000 tokens per minute. Additionally, the text-embedding-ada-002 model has been automatically deployed, and I increased its rate limit to 240,000 tokens per minute. While my chat playground functions correctly, I consistently face this error when I add my own data. Sometimes, it works briefly when I provide a first prompt, but it quickly reverts to the error message, "residing at 890 Lake Street." Could you please help me understand how to resolve this issue?
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Rate limit exceeded

1 answer

Your answer