What is the exact maximum input tokens of Azure GPT-3.5-turbo?

Tali.AI 20 Reputation points
2023-08-31T17:28:36.1233333+00:00

We have an endpoint for Azure GPT-3.5-turbo version 0301, which is said to support 4096 max input tokens. But when we send an input with 10K tokens, it actually works and generates the output without giving any errors about exceeding max tokens. The question I have is, what is the actual maximum number of input tokens for GPT-3.5-turbo? Does Azure automatically send long inputs to a larger model?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,153 questions
{count} votes