Increase My Context Windows In Azure OpenAI Service

Noel Wilson 0 Reputation points
2024-11-20T19:42:37.0966667+00:00

I am in the Microsoft Startup Hub program and I would like to increase the context windows for our models in Azure OpenAI Service

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,081 questions
{count} votes

1 answer

Sort by: Most helpful
  1. romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator
    2024-11-21T09:27:55.2066667+00:00

    @Noel Wilson Do you mean increasing the max request for input and output tokens for a particular model? On the models page, the documented max request tokens for each model is the maximum that can be used for the context window and I don' t think this can be increased beyond the maximum.

    The configurable limit of tokens per minute(TPM) is available on the quota page of the OpenAI studio. You can use this to configure to the maximum TPM limit. Is this what you are looking for?

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.