If we want to use OpenAI for commercial use with millions of request, do we need to ask for leveling the rate limit?

Sylvain Bouchard 0

If we want to use OpenAI for commercial use with millions of request, do we need to ask for leveling the rate limit?

Ramr-msft 17,731 Reputation points

2023-11-16T12:00:08.34+00:00

@Sylvain Bouchard Thanks for the question, The user would receive a 429 rate limit error and any calls to the API will timeout until the minute refreshes the requests and tokens. There are best practices published via OpenAI on exponential backoff to avoid these poor user experiences.

Here are advices that could help.

https://help.openai.com/en/articles/6891753-rate-limit-advice

https://clemenssiebler.com/posts/understanding-azure-openai-rate-limits-monitoring/