This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 81%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERJ%3C/text%3E%3C/svg%3E)
I'm trying to use assistants in the Azure AI Studio playground. I created a new hub and deployed a chat-gpt-4-mini model. I also created a new assistant with only a custom prompt. Almost any call returns a rate_limit_exceeded error message, even when I'm the only one calling the endpoint, and I'm waiting more than 1 minute between calls (anyway, the first call will usually fail). Is there anything I should configure on my end?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 78%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
Thank you for your question.
The "rate_limit_exceeded" error suggests that you've exceeded the allowed request threshold. Ensure your subscription's quota supports the usage level, and consider adjusting rate limits or scaling your deployment. Check for unintended calls that might be hitting the endpoint and review logs for patterns. If the issue persists, reach out to Azure supportfor further assistance, or try a simpler deployment to isolate the problem.
We haven’t heard from you on the last response and was just checking back to see if you got a chance to try above suggestions.
Thank you.
I ended setting a really high value (225) for Tokens per Minute Rate Limit (thousands) then it started working. I did't try what's the lower limit that would work.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 44%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3E6%3C/text%3E%3C/svg%3E)
Same problem here. What is it? I've got only 10 tokens so far while the limit is 10K per minute.
It just replies the first Hi message and then it stops with the crazy rate limit message.
It only replies the first Hi message and then return this crazy rate limit message for next input.
I ended setting a really high value (225) for Tokens per Minute Rate Limit (thousands) then it started working. I did't try what's the lower limit that would work.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 1%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EK%3C/text%3E%3C/svg%3E)
I'm having the same problem too. I am trying to assess Azure and seem to only make 1 request per minute despite 30k TPM which says is 300 RPM.
How did you set your limit to 225? Did you have to request an increase? Or did you upgrade your account? If you upgraded your account, can you explain where I could do that? I've looked everywhere