This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(310.4, 15%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EWC%3C/text%3E%3C/svg%3E)
Hello
I am following this tutorial https://microsoftlearning.github.io/mslearn-ai-agents/Instructions/02-build-ai-agent.html to create an AI Agent with Grounding with Bing Search. When I test it in Playground with a simple prompt, such as "what is the temperature of New York city today", it is getting Rate Limit Exceeded. It is using a deployed gpt-4 model with default rate limit of 8000 as tokens per minute and 48 as requests per minute.
Thanks
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(153.6, 16%, 24%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERG%3C/text%3E%3C/svg%3E)
Hi Wenjun Che,
It seems that there might be a rate limit issue with the AI Agent. Could you please provide a screenshot of the error message you are receiving? This will help us diagnose the problem more effectively.
Thank you.
Attached is the error message I received
Hi Wenjun Che,
We attempted to reproduce the issue using the exercise and obtained the following outcome, as shown in the screenshot below:
It appears that the rate limit for your deployed GPT-4 model may have been exceeded. Azure enforces strict limits on token consumption per minute, hour, and day, as well as the rate of API calls per second or minute. In some cases, underlying configuration issues can also trigger rate limit errors.
To resolve this, we recommend deleting the model, refreshing the environment, and redeploying it to reset any potential configuration issues. Please let us know if you need further assistance.
When I try to deploy gpt-4, the only version available is turbo-2024-04-09 (attached screenshot). How did you deploy version 0613 ? I want to select the same version to see if it works.AgentError.png
I just checked your screenshot again. Based on the answer, it does not look like you added Grounding with Bing Search in the Knowledge section. If you did, it should have search for the temperature with Bing Search for real time information, instead of saying not able to provide real-time updates.
I followed the instructions provided in the exercise document.
As per the document, Grounding with Bing Search cannot be added. It is only supported with the following Azure OpenAI models: gpt-3.5-turbo-0125, gpt-4-0125-preview, gpt-4-turbo-2024-04-09, gpt-4o-0513.
To address this issue, we have reached out to the content author for the earliest possible resolution.
I am actually using gpt-4-turbo-2024-04-09 when getting the error
However, Grounding with Bing Search cannot be added with the GPT-4 model, as stated in the exercise instructions. We have reached out to the internal team to request updates to the exercise document accordingly.
can you try one of gpt-3.5-turbo-0125, gpt-4-0125-preview, gpt-4-turbo-2024-04-09, gpt-4o-0513 to see if any works for you ?
We attempted to add multiple GPT models but encountered a "rate limit exceeded" error.
so you can reproduce the issue. What is the next step ?
Hi Wenjun Che,
We reached out to the content author regarding the issue, and they confirmed that it has been resolved. According to their response, the GPT model has been updated, and Grounding with Bing Search is now available as part of the model. Additionally, the rate-limiting issue is a known product-related limitation. If you encounter it, the recommended approach is to wait, as it should resolve itself over time.
Please reach out to us if you have any other queries.
If the information is helpful, please Accept Answer & Upvote so that it would be helpful to other community members.
Hello Rakesh
I just tried again as following:
This test has never worked for me, so I don't think it is related to "wait".
Hi Wenjun Che,
We just tried again to repro the issue by keeping the Tokens per Minute Rate Limit to 20K and it worked. We have seen minimum required TPM to use this model is 20k TPM.
Thank you.
Hello Rakesh
Which model did you test with? I just checked gpt-4 (v613) and the max TPM is 8k
Model- GPT-4
Model version: turbo-2024-04-09
TPM- 20k
Attached is the deployment page for turbo-2024-04-09 that I am seeing. The max TPM allowed is 8K.
Hi Wenjun Che,
It appears that your issue may be related to Azure OpenAI’s quota limits. Even after upgrading to a Pay-As-You-Go model, your subscription may still have usage restrictions for GPT-4.
Azure OpenAI applies rate limits per model and region, measured in Tokens-Per-Minute (TPM) and Requests-Per-Minute (RPM).
For more info, please refer to Manage Azure OpenAI Service quota.
Below is a screenshot showing where we were able to set the maximum TPM to 35k.
Hello Rakesh
I just got an email for my application for increasing quota being rejected. Here is the detail:
At this time your quota request cannot be processed.`` ``The region East US you requested a quota increase in is not available to expand capacity at this time.`` ``Please expand your regional choices when submitting a new request or wait 30+ days before resubmitting for a quota increase within the same region again.
Which region should I apply for quota increase?
Hi Wenjun Che,
Your request for a quota increases in the East US region was unfortunately denied due to capacity limitations. To proceed, we recommend selecting an alternative region with available capacity, such as Australia East or East US 2. You may refer to document for region availability details. To improve the chances of approval, please consider submitting a new request for one of these regions.
Hello Rakesh
My 2nd request got rejected as well: The region East US 2 you requested a quota increase in is not available to expand capacity at this time. I even checked Grant me quota in an alternate region and selected Anywhere in the USA.
What else can I do?
Finally I got it working by deploying gpt-4o to US West 3 with Global Standard.
Finally I got it working by deploying gpt-4o to US West 3 with Global Standard
I'm glad to hear that your issue has been resolved. As mentioned earlier, it may have been related to a product limitation based on the selected model.
Thank you.