Rate Limit Troubles on Azure for Students

Kaleb Cole 0 Reputation points
2024-08-30T09:05:30.12+00:00

Hello,

I am a student at RMIT University in Melbourne, Australia using my Azure for Students subscription for a group project. We are encountering issues with our chatbot's performance and need some assistance.

Specifically:

  1. We are using the standard pricing tier with the Azure for Students subscription, which has a cap of 1,000 tokens (as outlined https://learn.microsoft.com/en-us/azure/ai-services/openai/quotas-limits).
  2. Despite working with simple, low-token conversations, we frequently encounter rate limit errors. We're unsure why this is happening. We are not sending/receiving anywhere near 1k tokens. Image
  3. Our chatbot takes over a minute to respond, which we suspect may be related to these rate limits. Image
  4. We looked at this post (https://learn.microsoft.com/en-us/answers/questions/1696619/exceeded-token-rate-limit-for-first-(short)-prompt) and we are not able to select gpt-4-32k

Our resources are located in Australia East and we attempted in US East. Could you help us understand why these delays and rate limit issues are occurring and suggest any potential solutions?

Thank you for your support.

Best regards,

Kaleb

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,235 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,900 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.