Issue with Token Rate Limit when Uploading Files to OpenAI Playground

Question

Issue with Token Rate Limit when Uploading Files to OpenAI Playground

Jason 20

I am encountering an issue when using the Azure OpenAI API. When I send a prompt without attaching any file, the model responds as expected with information. However, when I attach a file to my prompt, I receive the following error message:

"Requests to the ChatCompletions_Create Operation under Azure OpenAI API version 2024-10-01-preview have exceeded token rate limit of your current AIServices S0 pricing tier. Please retry after 86400 seconds. Please contact Azure support service if you would like to further increase the default rate limit."

This issue occurs while using the free trial account. Could you please assist me with the following:

Why am I receiving this error when attaching a file, and how is it related to the token rate limit?
How can I resolve this issue without upgrading my account or increasing my current rate limit while still using the free trial account?
Are there any optimizations I can apply to prevent exceeding the token rate limit when uploading files, while still maintaining the ability to query with files?

I would appreciate any guidance or suggestions on how to overcome this limitation

kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-01-24T17:39:01.8366667+00:00
Hi Jason

Greetings & Welcome to the Microsoft Q&A forum! Thank you for sharing your query.

I understand that you're facing an issue Token rate limit uploading files When you attach a file to your prompt while using the Azure OpenAI API, the processing of that file counts towards your token rate limit. Each image processed counts towards your tokens per minute (TPM) limit, which is likely why you are encountering the error message indicating that you have exceeded the token rate limit for your current pricing tier.

The error occurs because the file you are attaching increases the token count being processed, which can quickly reach the limit set for your free trial account. The token rate limit is based on the maximum number of tokens that can be processed per minute, and attaching files can significantly increase that count.

To resolve this issue without upgrading your account or increasing your rate limit, you can try to minimize the size of the files you are uploading or reduce the frequency of your requests. Additionally, consider breaking down your queries into smaller parts or using simpler prompts that require less processing.

For optimizations, you can implement the following strategies:

Reduce the size of the files you upload to ensure they consume fewer tokens.

Space out your requests to avoid hitting the rate limit.

Use smaller or fewer files in your queries to keep the token count lower.

Please refer the documents services Quotas& limits Manage Azure open AI service Quota

I hope this helps you. Thank you.
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-01-26T15:23:40.29+00:00

Hi Jason

Following up to see if the above response was helpful.
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-01-27T08:12:34.0533333+00:00

Hi Jason

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Jason 20 Reputation points

2025-01-28T00:40:56.54+00:00
Hi Mr kothapally Snigdha,

Thanks for your reply, Apologies for the delayed response. I’m still having trouble understanding Microsoft Azure. Even though my file is very small (only 5 KB) and in .txt format, I continue to face the same issue when uploading the data. Even when the prompt is very short, only 10 characters,When I ask the AI to analyze it, I receive the same response.

Is there something wrong with the way I’m uploading the file?

Here’s the process I usually follow:

In the Chat Playground,

I click the 'Add Data' button

Choose the 'Data Source' option then select 'Upload File Preview,'

Pick my Blob Storage.

Select the 'Search Resource' with a basic subscription

create an index name

upload the file

Set the search type to 'Semantic' with a 1024 size.
Jason 20 Reputation points

2025-01-28T00:44:00.7766667+00:00
Hi Mr kothapally Snigdha,Thanks for your reply. Apologies for the delayed response. I’m still having trouble understanding Microsoft Azure. Even though my file is very small (only 5 KB) and in .txt format, I continue to face the same issue when uploading the data. Even when the prompt is very short, only 10 characters, When I ask the AI to analyze it, I receive the same response.

Is there something wrong with the way I’m uploading the file?

Here’s the process I usually follow:

In the Chat Playground, I click the 'Add Data' button

Choose the 'Data Source' option, then select 'Upload File Preview,'

Pick my Blob Storage

Select the 'Search Resource' with a basic subscription

Create an index name

Upload the file

Set the search type to 'Semantic' with a 1024 size.
Jason 20 Reputation points

2025-01-30T08:17:31.1533333+00:00

here is the screenshot without uploading data it works,

after i uploading data, it doesnt work
Jason 20 Reputation points

2025-01-30T08:27:34.55+00:00

hi, is there any solution ?
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-01-30T10:33:27.94+00:00

Hi Jason

sorry for delay

I was able to reproduce the scenario in my environment, and it is working as expected. Could you please increase the token rate limit and retry uploading the files?

I hope these helps you. Thank you.
Jason 20 Reputation points

2025-01-31T01:00:41.09+00:00

Hi Mr kothapally Snigdha,Thanks for your replies, how to increase the token rate limit ?

I cannot adjust the rate limit, can you show me how to do it ?

i'm having trouble while adjusting the token rate limit because the maximum rate limit is 1k in my account
Jason 20 Reputation points

2025-01-31T01:14:59.2566667+00:00

Also i cannot adjust/modify for another open AI Model and cannot lower the token rate limit, cannot modify the 1 k token rate limit
Jason 20 Reputation points

2025-02-04T03:00:18.73+00:00

Can anyone assist me? This issue is still occurring, and my free trial is about to end
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-02-04T22:38:21.4666667+00:00

Hi Jason

Following up to see if the response was helpful.
Jason 20 Reputation points

2025-02-10T01:41:16.4066667+00:00

Hi Mr kothapally Snigdha,

After the token was updated through the provided form, I was able to resolve the issue and now can upload and analyze the data.
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-02-10T05:57:57.7233333+00:00

Hi Jason

Thank you for confirming that the issue has been resolved. I'm glad to hear that you are now able to upload and analyze the data successfully.

Thank you!

Accepted answer

0 additional answers

Your answer

kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-01-24T17:39:01.8366667+00:00

Hi Jason

Greetings & Welcome to the Microsoft Q&A forum! Thank you for sharing your query.

I understand that you're facing an issue Token rate limit uploading files When you attach a file to your prompt while using the Azure OpenAI API, the processing of that file counts towards your token rate limit. Each image processed counts towards your tokens per minute (TPM) limit, which is likely why you are encountering the error message indicating that you have exceeded the token rate limit for your current pricing tier.

The error occurs because the file you are attaching increases the token count being processed, which can quickly reach the limit set for your free trial account. The token rate limit is based on the maximum number of tokens that can be processed per minute, and attaching files can significantly increase that count.

To resolve this issue without upgrading your account or increasing your rate limit, you can try to minimize the size of the files you are uploading or reduce the frequency of your requests. Additionally, consider breaking down your queries into smaller parts or using simpler prompts that require less processing.

For optimizations, you can implement the following strategies:

Reduce the size of the files you upload to ensure they consume fewer tokens.

Space out your requests to avoid hitting the rate limit.

Use smaller or fewer files in your queries to keep the token count lower.

Please refer the documents services Quotas& limits Manage Azure open AI service Quota

I hope this helps you. Thank you.
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-01-26T15:23:40.29+00:00

Hi Jason

Following up to see if the above response was helpful.
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-01-27T08:12:34.0533333+00:00

Hi Jason

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Jason 20 Reputation points

2025-01-28T00:40:56.54+00:00

Hi Mr kothapally Snigdha,

Thanks for your reply, Apologies for the delayed response. I’m still having trouble understanding Microsoft Azure. Even though my file is very small (only 5 KB) and in .txt format, I continue to face the same issue when uploading the data. Even when the prompt is very short, only 10 characters,When I ask the AI to analyze it, I receive the same response.

Is there something wrong with the way I’m uploading the file?

Here’s the process I usually follow:

In the Chat Playground,

I click the 'Add Data' button

Choose the 'Data Source' option then select 'Upload File Preview,'

Pick my Blob Storage.

Select the 'Search Resource' with a basic subscription

create an index name

upload the file

Set the search type to 'Semantic' with a 1024 size.
Jason 20 Reputation points

2025-01-28T00:44:00.7766667+00:00

Hi Mr kothapally Snigdha,Thanks for your reply. Apologies for the delayed response. I’m still having trouble understanding Microsoft Azure. Even though my file is very small (only 5 KB) and in .txt format, I continue to face the same issue when uploading the data. Even when the prompt is very short, only 10 characters, When I ask the AI to analyze it, I receive the same response.

Is there something wrong with the way I’m uploading the file?

Here’s the process I usually follow:

In the Chat Playground, I click the 'Add Data' button

Choose the 'Data Source' option, then select 'Upload File Preview,'

Pick my Blob Storage

Select the 'Search Resource' with a basic subscription

Create an index name

Upload the file

Set the search type to 'Semantic' with a 1024 size.
Jason 20 Reputation points

2025-01-30T08:17:31.1533333+00:00

here is the screenshot without uploading data it works,

after i uploading data, it doesnt work
Jason 20 Reputation points

2025-01-30T08:27:34.55+00:00

hi, is there any solution ?
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-01-30T10:33:27.94+00:00

Hi Jason

sorry for delay

I was able to reproduce the scenario in my environment, and it is working as expected. Could you please increase the token rate limit and retry uploading the files?

I hope these helps you. Thank you.
Jason 20 Reputation points

2025-01-31T01:00:41.09+00:00

Hi Mr kothapally Snigdha,Thanks for your replies, how to increase the token rate limit ?

I cannot adjust the rate limit, can you show me how to do it ?

i'm having trouble while adjusting the token rate limit because the maximum rate limit is 1k in my account
Jason 20 Reputation points

2025-01-31T01:14:59.2566667+00:00

Also i cannot adjust/modify for another open AI Model and cannot lower the token rate limit, cannot modify the 1 k token rate limit
Jason 20 Reputation points

2025-02-04T03:00:18.73+00:00

Can anyone assist me? This issue is still occurring, and my free trial is about to end
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-02-04T22:38:21.4666667+00:00

Hi Jason

Following up to see if the response was helpful.
Jason 20 Reputation points

2025-02-10T01:41:16.4066667+00:00

Hi Mr kothapally Snigdha,

After the token was updated through the provided form, I was able to resolve the issue and now can upload and analyze the data.
kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-02-10T05:57:57.7233333+00:00

Hi Jason

Thank you for confirming that the issue has been resolved. I'm glad to hear that you are now able to upload and analyze the data successfully.

Thank you!

Answer 1

Hi Jason

sorry for delay

To increase the token rate limit for your Azure OpenAI Service, you need to request a quota increase. Here are the steps you can follow.

Your maximum quota values may be lower if your Azure subscription is linked to certain offer types. For example, if you're on a free trial or a student subscription, your limit might be 1,000 tokens per minute.
You can submit a quota increase request via the quota increase request formNote that due to high demand, requests are filled in the order they are received, and priority is given to customers who are actively consuming their existing quota.
If you have the ability to modify your deployment settings, you can adjust the Tokens-Per-Minute (TPM) allocation. This can be done in the Azure AI Foundry portal under the Deployments section.
If you are unable to modify the rate limit due to your current subscription type, you may need to upgrade your subscription or change your offer type to access higher limits.

Kindly Refer these document https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/quota#understanding-rate-limits

I hope these helps you. Thank you!

kothapally Snigdha 3,020 Reputation points Microsoft External Staff Moderator

2025-02-10T05:58:56.2233333+00:00

Hi Jason

Following up to see if the above answer was helpful. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Share via

Issue with Token Rate Limit when Uploading Files to OpenAI Playground

0 additional answers

Your answer