Unable to provision Azure OpenAI deployments for some models

MANISH KUMAR RANA 20 Reputation points Microsoft Vendor
2024-03-25T17:30:05.6333333+00:00

I'm able to provision some OpenAI deployments for models such as gpt-4 0125-preview and gpt-4 vision-Preview. But, I can't provision deployments for other models that are available in the target region (EastUS) such as gpt-4-32k 0613 and gpt-4 0613.

 

I use pulumi for provisioning. Here is the output:

 


 

Resources:     + 2 to create     8 unchanged

 

Do you want to perform this update? details   pulumi:pulumi:Stack: (same)     [urn=urn:pulumi:development::azure-base::pulumi:pulumi:Stack::azure-base-development]     + azure-native:cognitiveservices:Deployment: (create)         [urn=urn:pulumi:development::azure-base::azure-native:cognitiveservices:Deployment::staging-gpt-4-0613]         [provider=urn:pulumi:development::azure-base::pulumi:providers:azure-native::default_2_28_0::fa5b8f72-cc20-461c-8508-278e5be6dfca]         accountName      : 'staging-eastus'         deploymentName   : 'staging-gpt-4-0613'         properties       : {             model: {                 format : 'OpenAI'                 name   : 'gpt-4'                 version: '0613'             }         }         resourceGroupName: 'staging-main-rg'         sku              : {             capacity: 10             name    : 'Standard'         }     + azure-native:cognitiveservices:Deployment: (create)         [urn=urn:pulumi:development::azure-base::azure-native:cognitiveservices:Deployment::staging-gpt-4-32k-0613]         [provider=urn:pulumi:development::azure-base::pulumi:providers:azure-native::default_2_28_0::fa5b8f72-cc20-461c-8508-278e5be6dfca]         accountName      : 'staging-eastus'         deploymentName   : 'staging-gpt-4-32k-0613'         properties       : {             model: {                 format : 'OpenAI'                 name   : 'gpt-4-32k'                 version: '0613'             }         }         resourceGroupName: 'staging-main-rg'         sku              : {             capacity: 10             name    : 'Standard'         }

 

Do you want to perform this update? yes Updating (development):      Type                                          Name                    Status                  Info      pulumi:pulumi:Stack                           azure-base-development  **failed**              1 error +   ├─ azure-native:cognitiveservices:Deployment  staging-gpt-4-0613      **creating failed**     1 error +   └─ azure-native:cognitiveservices:Deployment  staging-gpt-4-32k-0613  **creating failed**     1 error

 

Diagnostics:   azure-native:cognitiveservices:Deployment (staging-gpt-4-0613):     error: Code='SpecialFeatureOrQuotaIdRequired' Message='The current subscription does not have feature required by this model 'Format: OpenAI, Name: gpt-4, Version: 0613' and SKU 'Standard' on location EASTUS.'

 

  azure-native:cognitiveservices:Deployment (staging-gpt-4-32k-0613):     error: Code='SpecialFeatureOrQuotaIdRequired' Message='The current subscription does not have feature required by this model 'Format: OpenAI, Name: gpt-4-32k, Version: 0613' and SKU 'Standard' on location EASTUS.'

 

  pulumi:pulumi:Stack (azure-base-development):     error: update failed

 

Resources:     8 unchanged

 

Duration: 7s ```

 

The requested models are available in the EastUs region and are marked as Deployable.

 

Plese advise how to deploy these models.  
  
**Note-> I also tried using different regions   
I tried to deploy in EastUS2 region that according to [1] supports the 0613 gpt-4 models. This time I got a quota error:

Updating (development):      Type                                          Name                    Status                  Info      pulumi:pulumi:Stack                           azure-base-development  failed              1 error  +   ├─ azure-native:cognitiveservices:Deployment  staging-gpt-4-0613      creating failed     1 error  +   └─ azure-native:cognitiveservices:Deployment  staging-gpt-4-32k-0613  creating failed     1 error Diagnostics:   azure-native:cognitiveservices:Deployment (staging-gpt-4-0613):     error: Code="SpecialFeatureOrQuotaIdRequired" Message="The current subscription does not have feature required by this model 'Format: OpenAI, Name: gpt-4, Version: 0613' and SKU 'Standard' on location EASTUS2."   azure-native:cognitiveservices:Deployment (staging-gpt-4-32k-0613):     error: Code="SpecialFeatureOrQuotaIdRequired" Message="The current subscription does not have feature required by this model 'Format: OpenAI, Name: gpt-4-32k, Version: 0613' and SKU 'Standard' on location EASTUS2."   pulumi:pulumi:Stack (azure-base-development):     error: update failed


When I look at the quotas for EastUS 2 I don't see any mention of version such as 0613, but I see quota of 0/80 for GPT-4-Turbo. Does that cover the 0613 models
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,112 questions
{count} votes

Accepted answer
  1. AshokPeddakotla-MSFT 27,036 Reputation points
    2024-03-26T07:41:02.0066667+00:00

    MANISH KUMAR RANA Greetings!

    I'm able to provision some OpenAI deployments for models such as gpt-4 0125-preview and gpt-4 vision-Preview. But, I can't provision deployments for other models that are available in the target region (EastUS) such as gpt-4-32k 0613 and gpt-4 0613.

    Please note that, Version 0613 of gpt-4 and gpt-4-32k will be retired no earlier than September 30, 2024. See model updates for model upgrade behavior.

    Diagnostics:   azure-native:cognitiveservices:Deployment (staging-gpt-4-0613):     error: Code='SpecialFeatureOrQuotaIdRequired' Message='The current subscription does not have feature required by this model 'Format: OpenAI, Name: gpt-4, Version: 0613' and SKU 'Standard' on location EASTUS.'

    Regarding the error message, it indicates that the current subscription does not have the required feature for the specified model and SKU on location EASTUS.

    User's image

    Model availability always varies by region. considering the capacity constraints.

    Please check Model summary table and region availability for more information.

    To resolve this issue, please create a resource in any of the available regions other than US regions and see if that helps.

    I tried to deploy in EastUS2 region that according to [1] supports the 0613 gpt-4 models. This time I got a quota error: error: Code="SpecialFeatureOrQuotaIdRequired" Message="The current subscription does not have feature required by this model 'Format: OpenAI, Name: gpt-4-32k, Version: 0613' and SKU 'Standard' on location EASTUS2."   pulumi:pulumi:Stack (azure-base-development):     error: update failed

    I would request you, please fill out a quota increase request for the default rate limit for GPT4 in East US 2 at https://aka.ms/oai/quotaincrease

    I hope this helps. Do let me know if you have any further queries.

    2 people found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful