Azure OpenAI, getting "Completions call failed:OperationNotSupported"

Radlca 10

Anything I attempt in the Completions Playground with the GPT35 models results in a :

"The completion operation does not work with the specified model, gpt-35-turbo-16k. Please choose different model and try again. You can learn more about which models can be used with each operation here: https://go.microsoft.com/fwlink/?linkid=2197993. | Apim-request-id: dd518dc5-c0fb-48e6-9cfe-0763aa9ced7f"

The Ada model does not show up in the playground.

The playground recommends davinci-003 for my sample task, but does not allow me to deploy that model.

Thanks for the help

AshokPeddakotla-MSFT 34,616 Reputation points

2023-08-03T04:15:45.1833333+00:00

Radlca Greetings!

"The completion operation does not work with the specified model, gpt-35-turbo-16k. Please choose different model and try again. You can learn more about which models can be used with each operation here: https://go.microsoft.com/fwlink/?linkid=2197993. | Apim-request-id: dd518dc5-c0fb-48e6-9cfe-0763aa9ced7f"

Could you confirm if you are using GPT 3.5 (0301) or (0613) model?

As error suggests that, the completion operation is not supported by gpt-35-turbo-16k model.

As mentioned in the Model summary table and region availability page,

GPT-3.5 Turbo is used with the Chat Completion API. GPT-3.5 Turbo (0301) can also be used with the Completions API. GPT3.5 Turbo (0613) only supports the Chat Completions API. Please use the supported model version.

The Ada model does not show up in the playground.

Could you share more details about the region and the screenshot of the issue you are facing?

The playground recommends davinci-003 for my sample task, but does not allow me to deploy that model.

Looks like you are referring to Azure OpenAI Service legacy models.

As mentioned, The following models are not available for new deployments beginning July 6, 2023. Deployments created prior to July 6, 2023 remain available to customers until July 5, 2024. We recommend customers migrate to the replacement models prior to the July 5, 2024 retirement.

Hope this helps. Do let us know if that helps or have any other queries.
Radlca 10 Reputation points

2023-08-03T18:12:34.84+00:00

Thanks for the response!

The 0613 is the only GPT-3.5 version available to me (turbo and turbo 16k), and Ada. All of them throw out this error regardless of the sample task selected. The recommended model version is davinci-003 for most of the sample tasks but as you mentioned it seems that this model has been deprecated.

My region is East-US. Please let me know if this screenshot is what you wanted to see.
baleezo lee 5 Reputation points

2023-08-08T22:59:57.82+00:00

Same here https://learn.microsoft.com/en-us/answers/questions/1343154/openai-playground-summarization-example-respond-wi
AshokPeddakotla-MSFT 34,616 Reputation points

2023-08-09T03:31:12.85+00:00

Radlca & baleezo lee I'm looking into this issue and update you as earliest. Appreciate your time and patience.
AshokPeddakotla-MSFT 34,616 Reputation points

2023-08-17T05:44:49.3333333+00:00

Radlca Just checking to see if you had a chance to review the below response.

Do let us know if that helps or have any other queries.

If the response helped, please do click Accept Answer and Yes for was this answer helpful.

1 answer

AshokPeddakotla-MSFT 34,616 Reputation points

2023-08-10T14:04:10.3333333+00:00

Radlca

I have checked this internally and below is an update.

You should use "chat completions" instead of "completions" with these recent models. As documented here Azure OpenAI Service models - Azure OpenAI | Microsoft Learn, the 0613 revision of gpt-35-turbo is only compatible with that newer chat completions operation: "Completions" is now considered a supported but "legacy" feature for older models--and this is true for platform.openai.com in addition to Azure OpenAI.

If a customer absolutely must use the older completions operation instead of chat completions (e.g. because they've already made significant investments into fine-tuning or ChatML prompt engineering), they'll need to use a supported model/version as described on the matching documentation page here: Azure OpenAI Service legacy models.

Let me know if that helps or have any further queries.
Please sign in to rate this answer.
Radlca 10 Reputation points

2023-08-17T23:59:16.3033333+00:00

It now presents a response but still recommends using the davinci model, but when i click on "create a deployment" it fails to create that deployment. It seems like the front end capabilities do not match up with the back end?

AshokPeddakotla-MSFT 34,616 Reputation points

2023-08-18T13:49:03.4933333+00:00

Radlca Thanks for confirming that you are able to see the response.

I will share this feedback with the team. Do let me know if there are any further issues.

Troy Zhang 0 Reputation points

2023-08-26T06:23:12.4566667+00:00

if "completion" is considered to be legacy, shouldn't the playground updating the message to fresh users? I got the same confusion while playing with completion in the playground.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Azure OpenAI, getting "Completions call failed:OperationNotSupported"

1 answer

Your answer