Version update

Mansi Gusain 80

Hi I wanted to know that do models get updated by themselves once their default version gets updated?

Vinodh247 21,881 Reputation points

2024-09-20T05:26:55.32+00:00

Hi ,

Thanks for reaching out to Microsoft Q&A.

In Azure OpenAI Service, models do not get automatically updated when their default version is updated. When Azure releases a new version of a model, you typically need to explicitly select the updated version in your deployments or applications. This allows you to control which version of the model you are using in production.

If you want to use a new version, you would need to modify the deployment to point to that specific version. This can be done through the Azure Portal, CLI, or API by updating your model deployment configuration. This approach provides flexibility, allowing you to test newer versions before deciding to update your production environment.

Please 'Upvote'(Thumbs-up) and 'Accept' as an answer if the reply was helpful. This will benefit other community members who face the same issue.
navba-MSFT 24,795 Reputation points Microsoft Employee

2024-09-20T06:10:50.08+00:00

@Mansi Gusain Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

.

To ensure that the models update automatically, you need to make sure that you have selected the Auto update to default option while creating the model from Azure OpenAI Studio.

When you set your deployment to Auto-update to default, your model deployment is automatically updated within two weeks of a change in the default version. For a preview version, it updates automatically when a new preview version is available starting two weeks after the new preview version is released.

If you're still in the early testing phases for inference models, we recommend deploying models with auto-update to default set whenever it's available.

.

If you have already created the model, you can edit it and then select the above option.

.

Hope this helps. If you have any follow-up questions, please let me know. I would be happy to help.

**

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.
navba-MSFT 24,795 Reputation points Microsoft Employee

2024-09-23T06:40:24.44+00:00

@Mansi Gusain Just following up to check if the below answer helped. If that answers your query, do click "Accept the answer” for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let me know. I would be happy to help.
Mansi Gusain 80 Reputation points

2024-09-25T04:21:08.5233333+00:00
Hello, all thanks for answering and I apologize for the delay in reverting. I do believe that the either doing it manually auto-update to default or pointing to a version is the first solution. But if suppose I want to add in my script- auto-update to default instead of "2024-05-13", then how to do it?this is a terraform script. I wish to not do it manually I want it to point to default model from the script. Thanks in advance.

"gpt-4o" = { name = "gpt-4o" rai_policy_name = "Microsoft.Default" model_name = "gpt-4o" model_format = "OpenAI" model_version = "2024-05-13" scale_type = "Standard" capacity = var.models_quota.gpt4o }
Mansi Gusain 80 Reputation points

2024-09-25T04:48:34.06+00:00

I have found this thing= update_default_version=true, will try this thanks all :)
navba-MSFT 24,795 Reputation points Microsoft Employee

2024-09-25T04:58:48.7866667+00:00

@Mansi Gusain Thanks for the update. Please test it with the update_default_version=true and let us know how it goes. Awaiting your reply.
Mansi Gusain 80 Reputation points

2024-09-25T05:06:25.9933333+00:00

If there is some other config do share. Thanks :)

1 answer

navba-MSFT 24,795 Reputation points Microsoft Employee

2024-09-26T05:11:15.2133333+00:00
@Mansi Gusain Please refer to the version_upgrade_option attribute. More details here:

version_upgrade_option = (Optional) Deployment model version upgrade option. Possible values are OnceNewDefaultVersionAvailable, OnceCurrentVersionExpired, and NoAutoUpgrade. Defaults to OnceNewDefaultVersionAvailable. Changing this forces a new resource to be created.

name = string model_format = string model_name = string model_version = string scale_type = string rai_policy_name = optional(string) capacity = optional(number) version_upgrade_option = optional(string)

.

You could try setting it to the value OnceNewDefaultVersionAvailable.

.

More info is available in this terraform article. Hope this helps.

**

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.
Please sign in to rate this answer.
navba-MSFT 24,795 Reputation points Microsoft Employee

2024-09-27T04:34:13.46+00:00

@Mansi Gusain Just following up to check if the above answer helped. If that answers your query, do click "Accept the answer” for the same, which might be beneficial to other community members reading this thread. And, if you have any further query do let me know. I would be happy to help.

Mansi Gusain 80 Reputation points

2024-09-30T07:56:04.4666667+00:00

Hi thankyou for replying will try :)
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Version update

1 answer

Your answer