Unable to provision Azure OpenAI deployments for some models

Question

I'm able to provision some OpenAI deployments for models such as gpt-4 0125-preview and gpt-4 vision-Preview. But, I can't provision deployments for other models that are available in the target region (EastUS) such as gpt-4-32k 0613 and gpt-4 0613.

 

I use pulumi for provisioning. Here is the output:

 

 

Resources:     + 2 to create     8 unchanged

 

Do you want to perform this update? details   pulumi:pulumi:Stack: (same)     [urn=urn:pulumi:development::azure-base::pulumi:pulumi:Stack::azure-base-development]     + azure-native:cognitiveservices:Deployment: (create)         [urn=urn:pulumi:development::azure-base::azure-native:cognitiveservices:Deployment::staging-gpt-4-0613]         [provider=urn:pulumi:development::azure-base::pulumi:providers:azure-native::default_2_28_0::fa5b8f72-cc20-461c-8508-278e5be6dfca]         accountName      : 'staging-eastus'         deploymentName   : 'staging-gpt-4-0613'         properties       : {             model: {                 format : 'OpenAI'                 name   : 'gpt-4'                 version: '0613'             }         }         resourceGroupName: 'staging-main-rg'         sku              : {             capacity: 10             name    : 'Standard'         }     + azure-native:cognitiveservices:Deployment: (create)         [urn=urn:pulumi:development::azure-base::azure-native:cognitiveservices:Deployment::staging-gpt-4-32k-0613]         [provider=urn:pulumi:development::azure-base::pulumi:providers:azure-native::default_2_28_0::fa5b8f72-cc20-461c-8508-278e5be6dfca]         accountName      : 'staging-eastus'         deploymentName   : 'staging-gpt-4-32k-0613'         properties       : {             model: {                 format : 'OpenAI'                 name   : 'gpt-4-32k'                 version: '0613'             }         }         resourceGroupName: 'staging-main-rg'         sku              : {             capacity: 10             name    : 'Standard'         }

 

Do you want to perform this update? yes Updating (development):      Type                                          Name                    Status                  Info      pulumi:pulumi:Stack                           azure-base-development  **failed**              1 error +   ├─ azure-native:cognitiveservices:Deployment  staging-gpt-4-0613      **creating failed**     1 error +   └─ azure-native:cognitiveservices:Deployment  staging-gpt-4-32k-0613  **creating failed**     1 error

 

Diagnostics:   azure-native:cognitiveservices:Deployment (staging-gpt-4-0613):     error: Code='SpecialFeatureOrQuotaIdRequired' Message='The current subscription does not have feature required by this model 'Format: OpenAI, Name: gpt-4, Version: 0613' and SKU 'Standard' on location EASTUS.'

 

  azure-native:cognitiveservices:Deployment (staging-gpt-4-32k-0613):     error: Code='SpecialFeatureOrQuotaIdRequired' Message='The current subscription does not have feature required by this model 'Format: OpenAI, Name: gpt-4-32k, Version: 0613' and SKU 'Standard' on location EASTUS.'

 

  pulumi:pulumi:Stack (azure-base-development):     error: update failed

 

Resources:     8 unchanged

 

Duration: 7s ```

 

The requested models are available in the EastUs region and are marked as Deployable.

 

Plese advise how to deploy these models.  
  
**Note-> I also tried using different regions   
I tried to deploy in EastUS2 region that according to [1] supports the 0613 gpt-4 models. This time I got a quota error:

Updating (development):      Type                                          Name                    Status                  Info      pulumi:pulumi:Stack                           azure-base-development  failed              1 error  +   ├─ azure-native:cognitiveservices:Deployment  staging-gpt-4-0613      creating failed     1 error  +   └─ azure-native:cognitiveservices:Deployment  staging-gpt-4-32k-0613  creating failed     1 error Diagnostics:   azure-native:cognitiveservices:Deployment (staging-gpt-4-0613):     error: Code="SpecialFeatureOrQuotaIdRequired" Message="The current subscription does not have feature required by this model 'Format: OpenAI, Name: gpt-4, Version: 0613' and SKU 'Standard' on location EASTUS2."   azure-native:cognitiveservices:Deployment (staging-gpt-4-32k-0613):     error: Code="SpecialFeatureOrQuotaIdRequired" Message="The current subscription does not have feature required by this model 'Format: OpenAI, Name: gpt-4-32k, Version: 0613' and SKU 'Standard' on location EASTUS2."   pulumi:pulumi:Stack (azure-base-development):     error: update failed

When I look at the quotas for EastUS 2 I don't see any mention of version such as 0613, but I see quota of 0/80 for GPT-4-Turbo. Does that cover the 0613 models

Answer 1

MANISH KUMAR RANA Greetings!

I'm able to provision some OpenAI deployments for models such as gpt-4 0125-preview and gpt-4 vision-Preview. But, I can't provision deployments for other models that are available in the target region (EastUS) such as gpt-4-32k 0613 and gpt-4 0613.

Please note that, Version 0613 of gpt-4 and gpt-4-32k will be retired no earlier than September 30, 2024. See model updates for model upgrade behavior.

Diagnostics:   azure-native:cognitiveservices:Deployment (staging-gpt-4-0613):     error: Code='SpecialFeatureOrQuotaIdRequired' Message='The current subscription does not have feature required by this model 'Format: OpenAI, Name: gpt-4, Version: 0613' and SKU 'Standard' on location EASTUS.'

Regarding the error message, it indicates that the current subscription does not have the required feature for the specified model and SKU on location EASTUS.

Model availability always varies by region. considering the capacity constraints.

Please check Model summary table and region availability for more information.

To resolve this issue, please create a resource in any of the available regions other than US regions and see if that helps.

I tried to deploy in EastUS2 region that according to [1] supports the 0613 gpt-4 models. This time I got a quota error: error: Code="SpecialFeatureOrQuotaIdRequired" Message="The current subscription does not have feature required by this model 'Format: OpenAI, Name: gpt-4-32k, Version: 0613' and SKU 'Standard' on location EASTUS2."   pulumi:pulumi:Stack (azure-base-development):     error: update failed

I would request you, please fill out a quota increase request for the default rate limit for GPT4 in East US 2 at https://aka.ms/oai/quotaincrease

I hope this helps. Do let me know if you have any further queries.