Azure OpenAI, gpt-4o-mini have exceeded token rate limit of your current OpenAI S0 pricing tier.

Question

Azure OpenAI, gpt-4o-mini have exceeded token rate limit of your current OpenAI S0 pricing tier.

santai 0

User's image

When I use playgroud to chat. When I only type Text, it works well.

But when I upload an image. it prompts: Requests to the ChatCompletions_Create Operation under Azure OpenAI API version 2024-10-01-preview have exceeded token rate limit of your current OpenAI S0 pricing tier. Please retry after 86400 seconds. Please go here: https://aka.ms/oai/quotaincrease if you would like to further increase the default rate limit. | Apim-request-id: 5914fe68-c41b-4afe-8185-5b6fc55f0a4f

I caculated the uploaded image's tokens. The tokens value is 17650. I see my gpt-4o-mini TPM is 30K.

17,650 did not exceed 30k. so Why?

User's image

SriLakshmi C 6,250 Reputation points Microsoft External Staff Moderator

2024-11-15T11:50:09.87+00:00

Hello santai,

Welcome to Microsoft Q&A! Thanks for posting the question.

As I understand that you're encountering a token rate limit issue when uploading images in the Azure OpenAI Playground. this is due to several reasons,

Review the detailed quotas and limits for Azure OpenAI Service to understand the specific constraints for your model and pricing tier. please refer this document Azure OpenAI Service quotas and limits.

Reduce the size of the images before uploading to minimize the token count. Ensure the images are appropriately resized and compressed.

Do let us know if you any further queries. Thank you!
SriLakshmi C 6,250 Reputation points Microsoft External Staff Moderator

2024-11-18T11:05:26.3133333+00:00

Hi santai,

Following up to see if the above response was helpful. Thank you!
santai 0 Reputation points

2024-11-19T02:37:19.07+00:00

The problem has not been solved, and it has been more than 1 day now. I tried again, but it still doesn't work.
SriLakshmi C 6,250 Reputation points Microsoft External Staff Moderator

2024-11-19T17:16:59.4833333+00:00

Hello santai,

Could you please let me know the region you are using and the size of the image?
santai 0 Reputation points

2024-11-20T02:29:11.13+00:00

I raised the quota of gpt-4o-mini to 2000k per minute. Now it works well.
santai 0 Reputation points

2024-11-20T02:31:03.3166667+00:00

But I still don't know why when my quota is 30k, even small pictures will prompt that the rate limit is exceeded. And after 24 hours, it’s still not work.
SriLakshmi C 6,250 Reputation points Microsoft External Staff Moderator

2024-11-20T13:46:15.25+00:00
Hi santai,

Thank you for your follow-up query. The rate-limit errors at 30k could be due to backend processing delays or spikes in token usage beyond visible calculations. The 24-hour delay happens because exceeding the limit can trigger a cooldown period, temporarily restricting requests.

I recommend reporting this issue to the Azure OpenAI Services support team. They will be able to investigate the issue further and provide a more targeted solution. You can report the issue by following these steps:

Go to the Azure portal and navigate to your OpenAI Services resource.

Click on the "Support + troubleshooting" tab.

Fill out the required information, including a detailed description of the issue and any steps you have taken to troubleshoot it.

Submit the support request.

The Azure OpenAI Services support team will review your request and provide assistance as soon as possible.

1 answer

Your answer

SriLakshmi C 6,250 Reputation points Microsoft External Staff Moderator

2024-11-15T11:50:09.87+00:00

Hello santai,

Welcome to Microsoft Q&A! Thanks for posting the question.

As I understand that you're encountering a token rate limit issue when uploading images in the Azure OpenAI Playground. this is due to several reasons,

Review the detailed quotas and limits for Azure OpenAI Service to understand the specific constraints for your model and pricing tier. please refer this document Azure OpenAI Service quotas and limits.

Reduce the size of the images before uploading to minimize the token count. Ensure the images are appropriately resized and compressed.

Do let us know if you any further queries. Thank you!
SriLakshmi C 6,250 Reputation points Microsoft External Staff Moderator

2024-11-18T11:05:26.3133333+00:00

Hi santai,

Following up to see if the above response was helpful. Thank you!
santai 0 Reputation points

2024-11-19T02:37:19.07+00:00

The problem has not been solved, and it has been more than 1 day now. I tried again, but it still doesn't work.
SriLakshmi C 6,250 Reputation points Microsoft External Staff Moderator

2024-11-19T17:16:59.4833333+00:00

Hello santai,

Could you please let me know the region you are using and the size of the image?
santai 0 Reputation points

2024-11-20T02:29:11.13+00:00

I raised the quota of gpt-4o-mini to 2000k per minute. Now it works well.
santai 0 Reputation points

2024-11-20T02:31:03.3166667+00:00

But I still don't know why when my quota is 30k, even small pictures will prompt that the rate limit is exceeded. And after 24 hours, it’s still not work.
SriLakshmi C 6,250 Reputation points Microsoft External Staff Moderator

2024-11-20T13:46:15.25+00:00

Hi santai,

Thank you for your follow-up query. The rate-limit errors at 30k could be due to backend processing delays or spikes in token usage beyond visible calculations. The 24-hour delay happens because exceeding the limit can trigger a cooldown period, temporarily restricting requests.

I recommend reporting this issue to the Azure OpenAI Services support team. They will be able to investigate the issue further and provide a more targeted solution. You can report the issue by following these steps:

Go to the Azure portal and navigate to your OpenAI Services resource.

Click on the "Support + troubleshooting" tab.

Fill out the required information, including a detailed description of the issue and any steps you have taken to troubleshoot it.

Submit the support request.

The Azure OpenAI Services support team will review your request and provide assistance as soon as possible.

Answer 1

HI @santai

There is a token breakdown in the playground that you can check. see below.

The main reason i am guess is that you might have chat history in the request which will be included in the token. i.e. multiple chat turns in the chat window.

User's image

on top of this break down, you can also

use the view code option and switch to curl. run the curl -i in the bash to see the actual quota headers that shows remaining token and request allowed
use the switch to JSON object to inspect the full actual api request payload (that you shall see all chat histories)

Share via

Azure OpenAI, gpt-4o-mini have exceeded token rate limit of your current OpenAI S0 pricing tier.

1 answer

Your answer