Can't test agent in the AI Foundry Playground

Question

Can't test agent in the AI Foundry Playground

Reynold 0

When I try to test the created agent in the AI Foundry Playground, I get the error: "Rate Limit Exceeded. Adjust your tokens per minute rate limit in Models + Endpoints (link) or try again later." But the rate limit is set to 5K per minute.

Marcin Policht 50,895 Reputation points MVP Volunteer Moderator

2025-03-12T13:54:31.4+00:00

As per https://learn.microsoft.com/en-us/azure/machine-learning/how-to-manage-quotas?view=azureml-api-2

A quota is a credit limit on Azure resources, not a capacity guarantee.

Looks like you'd need to try again later

If the above response helps answer your question, remember to "Accept Answer" so that others in the community facing similar issues can easily find the solution. Your contribution is highly appreciated.

hth

Marcin
Saideep Anchuri 9,500 Reputation points Moderator

2025-03-13T10:18:23.0733333+00:00

Hi Reynold

It seems that you are encountering a "Rate Limit Exceeded" error having set your tokens per minute (TPM) rate limit to 5K. This could be due to the way Azure OpenAI Service calculates rate limits. The TPM rate limits are based on the maximum number of tokens estimated to be processed by a request at the time the request is received.

If the estimated max-processed-token count for your requests exceeds the set limit, you will receive a 429 response code, if your requests are not evenly distributed over a one-minute period, it may also trigger rate limiting. try increasing the rate limit beyond 5K per minute. You might need to request a higher quota from Azure support if your current subscription doesn't allow for a higher limit.

Kindly refer below link: ManageAzure OpenAI Service quota

Thank You.
Reynold 0 Reputation points

2025-03-13T10:41:56.2+00:00

@Saideep Anchuri Set to 8K, I just say "Hello" to agent, and error exits :) It about hundreds of tokens, not thousands. Rate limit much more beyond then my actual usage.
Saideep Anchuri 9,500 Reputation points Moderator

2025-03-13T11:41:19.49+00:00

Hi Reynold

Please increase the TPM to 30K.Retry as it is not working under 30K.

Thank You.
Saideep Anchuri 9,500 Reputation points Moderator

2025-03-16T11:22:12.6066667+00:00

Hi Reynold

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.

Thank you.
Reynold 0 Reputation points

2025-03-16T16:50:08.34+00:00

I asked a question that something is not working with that agent, ‘There is fuel, but the car doesn’t move,’ and you respond, ‘Just add more fuel, and it will start working.’ Do you think such a solution would work in real life?
Saideep Anchuri 9,500 Reputation points Moderator

2025-03-17T03:56:56.26+00:00
Hi Reynold

I recommend reporting this issue to the Azure support team. They will be able to investigate the issue further and provide a more targeted solution. You can report the issue by following these steps:

Go to the Azure portal and navigate to your OpenAI Service resource.

Click on the "Support + troubleshooting" tab.

Fill out the required information, including a detailed description of the issue and any steps you have taken to troubleshoot it.

Submit the support request.

The Azure support team will review your request and provide assistance as soon as possible Azure support.

Thank You.

Your answer

Marcin Policht 50,895 Reputation points MVP Volunteer Moderator

2025-03-12T13:54:31.4+00:00

As per https://learn.microsoft.com/en-us/azure/machine-learning/how-to-manage-quotas?view=azureml-api-2

A quota is a credit limit on Azure resources, not a capacity guarantee.

Looks like you'd need to try again later

If the above response helps answer your question, remember to "Accept Answer" so that others in the community facing similar issues can easily find the solution. Your contribution is highly appreciated.

hth

Marcin
Saideep Anchuri 9,500 Reputation points Moderator

2025-03-13T10:18:23.0733333+00:00

Hi Reynold

It seems that you are encountering a "Rate Limit Exceeded" error having set your tokens per minute (TPM) rate limit to 5K. This could be due to the way Azure OpenAI Service calculates rate limits. The TPM rate limits are based on the maximum number of tokens estimated to be processed by a request at the time the request is received.

If the estimated max-processed-token count for your requests exceeds the set limit, you will receive a 429 response code, if your requests are not evenly distributed over a one-minute period, it may also trigger rate limiting. try increasing the rate limit beyond 5K per minute. You might need to request a higher quota from Azure support if your current subscription doesn't allow for a higher limit.

Kindly refer below link: ManageAzure OpenAI Service quota

Thank You.
Reynold 0 Reputation points

2025-03-13T10:41:56.2+00:00

@Saideep Anchuri Set to 8K, I just say "Hello" to agent, and error exits :) It about hundreds of tokens, not thousands. Rate limit much more beyond then my actual usage.
Saideep Anchuri 9,500 Reputation points Moderator

2025-03-13T11:41:19.49+00:00

Hi Reynold

Please increase the TPM to 30K.Retry as it is not working under 30K.

Thank You.
Saideep Anchuri 9,500 Reputation points Moderator

2025-03-16T11:22:12.6066667+00:00

Hi Reynold

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.

Thank you.
Reynold 0 Reputation points

2025-03-16T16:50:08.34+00:00

I asked a question that something is not working with that agent, ‘There is fuel, but the car doesn’t move,’ and you respond, ‘Just add more fuel, and it will start working.’ Do you think such a solution would work in real life?
Saideep Anchuri 9,500 Reputation points Moderator

2025-03-17T03:56:56.26+00:00

Hi Reynold

I recommend reporting this issue to the Azure support team. They will be able to investigate the issue further and provide a more targeted solution. You can report the issue by following these steps:

Go to the Azure portal and navigate to your OpenAI Service resource.

Click on the "Support + troubleshooting" tab.

Fill out the required information, including a detailed description of the issue and any steps you have taken to troubleshoot it.

Submit the support request.

The Azure support team will review your request and provide assistance as soon as possible Azure support.

Thank You.

Share via

Can't test agent in the AI Foundry Playground

Your answer