I've noticed that the knowdage of the model, gpt-4-turbo, varies between Azure OpenAI and OpenAI.

David Swift 105 Reputation points

I was thrilled to discover recently that Azure OpenAI has launched GPT-4 Turbo, boasting a 128k context window and a maximum 4k token output. Initially, I assumed Azure OpenAI's GPT-4 Turbo was identical to GPT-4-1106-preview, only to find it was not so. To clarify, Azure OpenAI's GPT-4-1106-preview is a model featuring an 8k context window and also a maximum 4k output. I'm eager to understand how I can access GPT-4 Turbo. Given our past disappointment with OpenAI's performance, we're keen on utilizing this sophisticated model in Azure OpenAI. I'd greatly appreciate any guidance provided.

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
1,395 questions
{count} votes

Accepted answer
  1. Saurabh Sharma 21,101 Reputation points Microsoft Employee

    @David Swift

    For your first issue about the context window, the product team has confirmed that this is a UI limitation. I am still waiting for their confirmation on whether they will update the studio UX to allow a higher input token limit by default.

    Now, regarding your second issue of training, this is an expected behavior and part of the problem is that it both doesn't know about itself (refer to - When I ask GPT-4 what model it's running it tells me it's running GPT-3. Why does this happen?) and without RAG augmentation isn't a 100% reliable source of facts in general though it will often get things right if it has seen enough instances of something in its training data.

    For newer info it isn't surprising that older info that would have more occurrences in the training data might crowd out newer info depending on how a question is asked. The training data definitely goes beyond 2021.

    Here is an example question you can ask to see that training data goes beyond 2021:

    User's image

    Product team is internally working to get this information updated to under FAQs as well.

    Please let me know if you have any questions.



    Please 'Accept as answer' and Upvote if it helped so that it can help others in the community looking for help on similar topics.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful