Share via

Question Regarding Reflection Time for Version Changes in Azure OpenAI

85795786 60 Reputation points
2025-02-25T10:49:40.72+00:00

The following text has been translated from Japanese to English using a translation tool. Please excuse any awkward phrasing or errors in the text.**

Question:**

We would like to inquire about the propagation time for updating the deployed model version in Azure OpenAI.

Background:

We changed the deployed "2024-05-13" version resource of 4o to "2024-11-20", but the specification of the response_format type json_schema, which is available from the 2024-08-06 version onwards, returns the following error:

"Invalid parameter: 'response_format' of type 'json_schema' is not supported with this model. Learn more about supported models at the Structured Outputs guide: https://platform.openai.com/docs/guides/structured-outputs"

Performed Verification:

  • The same error occurred via the API and the chat playground.
  • We have confirmed that the console display shows "2024-11-20".
  • We are using API version 2024-10-21.
  • After confirming this issue, we deleted the deployment and redeployed with the 2024-11-20 version. As a result, we were able to send requests normally with the same parameters and prompts.

From the above, we believe that although the console display has been changed, the actual reflection is taking time.

The following is the original Japanese text.
【お聞きしたい内容】

AzureOpenAIでデプロイしているモデルのバージョンを更新した際に反映にかかる時間がどれくらいかかるのかお伺いしたいです。

【背景】

デプロイしている4oの"2024-05-13"バージョンリソースを"2024-11-20"変更したが、2024-08-06バージョン以降で使用できるresponse_formatのタイプjson_schemaの指定が以下のエラーで返ってきます。

"Invalid parameter: 'response_format' of type 'json_schema' is not supported with this model. Learn more about supported models at the Structured Outputs guide: https://platform.openai.com/docs/guides/structured-outputs"

【行った確認作業】

・API経由でもチャットプレイグラウンドでも同様のエラーでした。

・コンソール画面からの表示では2024-11-20になっていることを確認できております。

・APIバージョンは2024-10-21を使用しております。・本事象確認後、一度デプロイを削除し、2024-11-20バージョンでデプロイしなおしたところ、　同じパラメータ、プロンプトで正常にリクエストを送ることができました。以上のことから、コンソール上では変更されているが、実際の反映に時間がかかるものと考えております。

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,106 questions
Accepted answer
  1. SriLakshmi C 6,250 Reputation points Microsoft External Staff Moderator
    2025-02-28T10:17:48.5366667+00:00

    Hi 85795786

    I'm glad to hear that your issue has been resolved. And thanks for sharing the information, which might be beneficial to other community members reading this thread as solution. Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", so I'll reiterate the previous response to an answer in case you'd like to accept the answer. This will help other users who may have a similar query find the solution more easily. 

    Ask: Question Regarding Reflection Time for Version Changes in Azure OpenAI

    Solution: I have confirmed the response before translation. I was considering an update method that would not cause downtime for the application I am using, but I felt that redeploying would be the most reliable way.

     If you have any further questions or concerns, please don't hesitate to ask. We're always here to help.

    Thank you!

    1 person found this answer helpful.

1 additional answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. 85795786 60 Reputation points
    2025-02-28T05:11:26.0666667+00:00

    I have confirmed the response before translation. Thank you for your reply. I was considering an update method that would not cause downtime for the application I am using, but I felt that redeploying would be the most reliable way. Thank you very much.

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.