What does Ratelimit metric means in Azure OpenAI Serive

杭州心识 0 Reputation points
2023-08-22T03:54:51.98+00:00

Hello, I'm just confused by the description of the ratelimit metric below. Dose it mean the times you reach out the ratelimit of the service?(exceed the token per minute?)User's image

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,133 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Ramr-msft 17,736 Reputation points
    2023-08-31T04:29:56.55+00:00

    @杭州心识 Yes they do. We're working on a better definition of this metric, but no ETA at the moment. the best way to view it is to use the average, not the sum function. But it's really only telling you the # of times you reach a limit.... which isn't particularly informative without other info joined with the metric.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.