gtp-4o-mini model says he is ChatGPT3 and has knowledge cutoff September 2021

Question

gtp-4o-mini model says he is ChatGPT3 and has knowledge cutoff September 2021. gtp-4o-mini documentation says knowledge cutoff is October 2023. How is this possible? I've triple checked deployment and it's the correct model. gtp-4o (not mini) correctly says he is GTP4 and has knowledge cutoff October 2023

gtp-4o-mini:

(deployment)

Answer 1

Christian Greetings & Welcome to Microsoft Q&A forum!

gtp-4o-mini model says he is ChatGPT3 and has knowledge cutoff September 2021. gtp-4o-mini documentation says knowledge cutoff is October 2023. How is this possible? I've triple checked deployment and it's the correct model. gtp-4o (not mini) correctly says he is GTP4 and has knowledge cutoff October 2023

I understand that you are getting different result than the deployed model and cutoff date.

This is expected behavior. Azure OpenAI models aren't able to answer questions about themselves. To know more details about the knowledge cutoff for the model's training data, please check the models page.

The model is performing next token prediction in response to your question. The model doesn't have any native ability to query what model version is currently being run to answer your question. To answer this question, you can always go to Azure OpenAI Studio > Management > Deployments > and consult the model name column to confirm what model is currently associated with a given deployment name.

If you wanted to help a GPT based model to accurately respond to the question "what model are you running?", you would need to provide that information to the model through techniques like prompt engineering of the model's system message, Retrieval Augmented Generation (RAG) which is the technique used by Azure OpenAI on your data where up-to-date information is injected to the system message at query time, or via fine-tuning where you could fine-tune specific versions of the model to answer that question in a certain way based on model version.

Please check Azure OpenAI Service frequently asked questions for more details.

Do let me know if that helps or have any other queries.

---

If the response helped, please do click Accept Answer and Yes for was this answer helpful.

Doing so would help other community members with similar issue identify the solution. I highly appreciate your contribution to the community.