Azure OpenAI GPT Turbo 3.5 Instruct Model - Max Tokens (Request)

Test Admin 171 Reputation points
2023-10-13T08:51:08.7133333+00:00

We are using Azure OpenAI gpt-3.5-turbo-instruct (0914) model with Standard tier.

We have a query regarding the maximum tokens(context length) of gpt-3.5-turbo-instruct (0914).

As it is mentioned in the Microsoft documentation that gpt-3.5-turbo-instruct (0914) only accepts the maximum tokens - 4097 tokens
https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models#gpt-35-models

But when we sent request using Java Application and Postman is accepts maximum context length - 5000 tokens
Also in Azure OpenAI Studio(PlayGround) it accepts maximum tokens - 4000 tokens

Question:
What is actual context length (max tokens) of gpt-3.5-turbo-instruct (0914) model?

Thanks in advance.

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,267 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,441 questions
{count} votes