Chat completion is doesnt work with text-embedding-ada-002 and embedding doesnt work with GPT-3.5-Turbo.

Question

I have tried the chat completion with GPT-3.5-Turbo.

It gives following error

https://github.com/langchain-ai/langchain/issues/3148

So based on this error if I use text-embedding-ada-002 then I receive below error.

InvalidRequestError: The completion operation does not work with the specified model, text-embedding-ada-002. Please choose different model and try again. You can learn more about which models can be used with each operation here: https://go.microsoft.com/fwlink/?linkid=2197993.

Is there a working solution with any model that we could do a chat completion API call.

Answer 1

Vaishnavi Yadati Greetings& Welcome to Microsoft Q&A forum!

I have tried the chat completion with GPT-3.5-Turbo. It gives following error https://github.com/langchain-ai/langchain/issues/3148

It would be great if you can add specific error message with the GPT-3.5-Turbo model. As per my understanding the context of the issue, The error message you are getting with Completion operation is not supported by gpt-35-turbo(0613) and gpt-35-turbo-16k(0613) models.

These models only support Chat Completions API.

As mentioned on the models page, The most capable and cost effective model in the GPT-3.5 family is GPT-3.5 Turbo, which has been optimized for chat and works well for traditional completions tasks as well.

GPT-3.5 Turbo is available for use with the Chat Completions API. GPT-3.5 Turbo Instruct has similar capabilities to text-davinci-003 using the Completions API instead of the Chat Completions API. We recommend using GPT-3.5 Turbo and GPT-3.5 Turbo Instruct over legacy GPT-3.5 and GPT-3 models.

• gpt-35-turbo
• gpt-35-turbo-16k
• gpt-35-turbo-instruct

This model has performance comparable to text-davinci-003 and is available to use with the Completions API.

Only older turn model - GPT-3.5 Turbo (0301) supports both Chat and completions API.

You can also check the Models page of Azure AI Studio which shows the features supported by the Models such as completions/embeddings as shown below.

So based on this error if I use text-embedding-ada-002 then I receive below error. InvalidRequestError: The completion operation does not work with the specified model, text-embedding-ada-002. Please choose different model and try again. You can learn more about which models can be used with each operation here: https://go.microsoft.com/fwlink/?linkid=2197993.

Please check the specific versions as mentioned above and try.

Do let me know if that helps or have any further queries.