GPT-4 Models Availability in Azure

Question

GPT-4 Models Availability in Azure

Leon H 5

I have ResourceGroup "AzureOpenAI" in region "East US" and under it I have Resource "AzureOpenAIExperiment" also in "East ES". I have GPT-3.5 models deployed. When I go to Azure AI Studio and want to deploy GPT-4 models (not necessarily the latest one, neither preview) they are missing from the model list - not even one....

When I look at Microsoft documentation:
https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models#gpt-4-models
Specifically, at the table named: GPT-4 and GPT-4 Turbo Preview model availability, which specifies availability by the region. I see that GPT-4 models (0314) and (0613) are supposed to be available in East US region. So why am I missing them from the Deployment list? (I am at S0 pricing tier)

Udaiappa Ramachandran 726 Reputation points MVP

2024-01-02T02:55:35.2866667+00:00

I don't see it from my subscription either. This could be due to capacity constraints.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-02T05:05:01.54+00:00

@Leon H Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

Here are some of the action plan which you should follow:

Plan 1:

Could you please click on this link to access the model catalog in Azure AI Studio ?
Search for gpt-4 as shown below:

Select Deploy button:

.
Try to select the project or create a new project and see if that gives any error or warning while deploying. Please be aware that the Availability varies by region. If you don't see GPT-4 in your region, please check back later.
.
Plan 2:
Alternatively try deploying to other regions (highlighted in below table) and check if that helps.
.
Plan 3:
If you specifically need access for the Gpt4 (0314) and (0613) model versions in a particular region (East US), then you need to fill the request form https://aka.ms/oai/quotaincrease. In this form, in Box 11, You need to provide valid reasons / justifications as to why do you need it in East US.

Be aware that the Regional availability is limited. We’re seeing very high demand in our US regions. Capacity requests will be granted on a space available basis, and we may grant your capacity in alternate geographies if the one you requested is not available.
.

On a side note: Please check this article which talks about the GPT-4 and GPT-4 Turbo Preview model availability based on regions.

.

Hope this helps.
machbrown2 0 Reputation points

2024-01-02T06:02:16.7566667+00:00
Hello,
If you are experiencing issues with missing GPT-4 models in Azure AI Studio, despite them being listed as available in the documentation, there are a few potential reasons for this discrepancy. Here are some steps you can take to troubleshoot and resolve the issue:

Service Status:

Check the Azure service status dashboard to see if there are any ongoing issues or maintenance activities that might be affecting the availability of GPT-4 models in your region.

Azure Subscription:

Ensure that your Azure subscription associated with the "AzureOpenAI" resource group is in good standing. Some features may be limited or unavailable if there are issues with your subscription.

Region-Specific Availability:

Confirm that you are deploying models in the correct region ("East US" in your case), as availability can vary by region. Double-check the region settings for both your AzureOpenAI resource group and the AzureOpenAIExperiment resource.

Pricing Tier:

Verify that your pricing tier (S0) supports the deployment of GPT-4 models. Some features may have tier-specific limitations, so it's crucial to ensure that your selected pricing tier aligns with the desired model capabilities.

Azure AI Studio Cache:

Clear the cache or refresh the Azure AI Studio page to ensure that you are viewing the latest information. Sometimes, cached data might cause discrepancies in the displayed model list.

Contact Azure Support:

If the issue persists, consider reaching out to Azure Support for assistance. They can investigate the problem and provide guidance on resolving any potential configuration or availability issues.

Documentation Updates:

Confirm that you are referring to the most up-to-date Azure documentation. Updates to the service or model availability may not be immediately reflected in the documentation, so check for the latest information.

Review Resource Group and Experiment Configuration:

Double-check the configurations of your resource group and experiment in Azure AI Studio. Ensure that all settings align with the requirements for deploying GPT-4 models.

If none of these steps resolves the issue, contacting Azure Support or consulting the Azure community forums might provide additional insights and assistance. Keep in mind that Azure services and model availability can evolve, so staying informed about updates and changes is essential.
Leon H 5 Reputation points

2024-01-03T00:52:59.4866667+00:00

Plan 1:
"Unable to deploy to this subscription and this region"

Plan 2:
**When you say: deploy to other regions, does it mean that I have to move the entire resource or resource group to another regions. Will this change KeyAPI, endpoint, etc.?
**
Plan 3:
My resource is East US and your docs say that GPT-4 is available (that why I selected the East US - I am located on Pacific Coast). So I have no choice but to connect to your support - "mission impossible 7".
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-03T04:07:16.71+00:00

@Leon H Thanks for getting back and providing an update.
.
You will have to follow the Plan 3 mentioned above to gain access to deploy in East US region. Please check the highlighted section (YELLOW and BLUE) in below screenshot. By default, East Us region is NOT available.

So, you will get the access to EAST US region only if you fill and submit this request form https://aka.ms/oai/quotaincrease.
.
Regarding your point about GPT-4 being made available East US, it will be allowed only if the model access is approved by filling the above form. Hope this clarifies and clears your confusion.

.
If you have any follow-up questions, please let me know, I would be happy to help.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-05T04:50:04.38+00:00

@Leon H Could you please let me know if you had chance to look at my above comment ? Please let me know if you had a chance to submit the form https://aka.ms/oai/quotaincrease. to gain access to GPT4 in East US region. Also do let me know if you have any follow-up questions. I would be happy to help.
Leon H 5 Reputation points

2024-01-05T16:12:31.0533333+00:00

Yes, I submitted the request shortly thereafter, although the form is for extending the existing quotas... I explained in it that I need GPT-4 availability for my S0 Azure OpenAI resource.
No response yet.
Ahamed Musthafa Careem 461 Reputation points

2024-01-06T01:58:27.3133333+00:00

GPT 4 is available. To get the access you need to fill a form provided by Microsoft.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-06T07:12:39.6633333+00:00

@Leon H Thanks for getting back. Please confirm if you have received an email from Microsoft Azure OpenAI msazureopenai@microsoft.com after submitting the form ?

.
If Yes, Please email me the below details over email to azcommunity[at]microsoft[dot]com with subject as "Attn: NAVBA " , so that I can ask the concerned team to prioritize your access request:

a. Subscription ID.
b. Application ID from the email that you have received

Awaiting your reply.
.

In the meantime, until the request has been approved, You can also invoke the below REST API by clicking on the TryIt option in the below article and can keep track of your request and check if the state appears as Registered:

https://learn.microsoft.com/en-us/rest/api/resources/features/list?view=rest-resources-2021-07-01&tabs=HTTP&tryIt=true&source=docs#code-try-0
.

.
Hope this helps.
Leon H 5 Reputation points

2024-01-07T18:26:47.4966667+00:00

No response from msazureopenai@microsoft.com so far.
Leon H 5 Reputation points

2024-01-07T18:27:30.3933333+00:00

No response from msazureopenai@microsoft.com so far.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-08T04:43:07.3633333+00:00

@Leon H Thanks for your reply. Could you please email me the below details over email to azcommunity[at]microsoft[dot]com with subject as "Attn: NAVBA " , so that I can ask the concerned team to prioritize your access request:

a. Subscription ID.
b. Application ID from the email that you have received

Awaiting your reply.
Leon H 5 Reputation points

2024-01-09T03:24:27.43+00:00

I tried.

Unfortunately, I get:

***The group mtmvp only accepts messages from people in its organization or on its allowed senders list, and your email address isn't on the list.

Sender not allowed.***
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-09T04:52:10.98+00:00

@Leon H I have replied to your email. Please check once you get a chance.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-15T04:16:59.0266667+00:00

@Leon H Please let me know if you had a chance to look at my below updated comment.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-17T05:50:29.4766667+00:00

@Leon H Please let me know if you had a chance to look at my below comment. Also do let me know if you have any follow-up questions on this. Awaiting your reply.

1 answer

Your answer

Udaiappa Ramachandran 726 Reputation points MVP

2024-01-02T02:55:35.2866667+00:00

I don't see it from my subscription either. This could be due to capacity constraints.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-02T05:05:01.54+00:00

@Leon H Welcome to Microsoft Q&A Forum, Thank you for posting your query here!

Here are some of the action plan which you should follow:

Plan 1:

Could you please click on this link to access the model catalog in Azure AI Studio ?
Search for gpt-4 as shown below:

Select Deploy button:

.
Try to select the project or create a new project and see if that gives any error or warning while deploying. Please be aware that the Availability varies by region. If you don't see GPT-4 in your region, please check back later.
.
Plan 2:
Alternatively try deploying to other regions (highlighted in below table) and check if that helps.
.
Plan 3:
If you specifically need access for the Gpt4 (0314) and (0613) model versions in a particular region (East US), then you need to fill the request form https://aka.ms/oai/quotaincrease. In this form, in Box 11, You need to provide valid reasons / justifications as to why do you need it in East US.

Be aware that the Regional availability is limited. We’re seeing very high demand in our US regions. Capacity requests will be granted on a space available basis, and we may grant your capacity in alternate geographies if the one you requested is not available.
.

On a side note: Please check this article which talks about the GPT-4 and GPT-4 Turbo Preview model availability based on regions.

.

Hope this helps.
Leon H 5 Reputation points

2024-01-03T00:52:59.4866667+00:00

Plan 1:
"Unable to deploy to this subscription and this region"

Plan 2:
**When you say: deploy to other regions, does it mean that I have to move the entire resource or resource group to another regions. Will this change KeyAPI, endpoint, etc.?
**
Plan 3:
My resource is East US and your docs say that GPT-4 is available (that why I selected the East US - I am located on Pacific Coast). So I have no choice but to connect to your support - "mission impossible 7".
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-03T04:07:16.71+00:00

@Leon H Thanks for getting back and providing an update.
.
You will have to follow the Plan 3 mentioned above to gain access to deploy in East US region. Please check the highlighted section (YELLOW and BLUE) in below screenshot. By default, East Us region is NOT available.

So, you will get the access to EAST US region only if you fill and submit this request form https://aka.ms/oai/quotaincrease.
.
Regarding your point about GPT-4 being made available East US, it will be allowed only if the model access is approved by filling the above form. Hope this clarifies and clears your confusion.

.
If you have any follow-up questions, please let me know, I would be happy to help.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-05T04:50:04.38+00:00

@Leon H Could you please let me know if you had chance to look at my above comment ? Please let me know if you had a chance to submit the form https://aka.ms/oai/quotaincrease. to gain access to GPT4 in East US region. Also do let me know if you have any follow-up questions. I would be happy to help.
Leon H 5 Reputation points

2024-01-05T16:12:31.0533333+00:00

Yes, I submitted the request shortly thereafter, although the form is for extending the existing quotas... I explained in it that I need GPT-4 availability for my S0 Azure OpenAI resource.
No response yet.
Ahamed Musthafa Careem 461 Reputation points

2024-01-06T01:58:27.3133333+00:00

GPT 4 is available. To get the access you need to fill a form provided by Microsoft.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-06T07:12:39.6633333+00:00

@Leon H Thanks for getting back. Please confirm if you have received an email from Microsoft Azure OpenAI msazureopenai@microsoft.com after submitting the form ?

.
If Yes, Please email me the below details over email to azcommunity[at]microsoft[dot]com with subject as "Attn: NAVBA " , so that I can ask the concerned team to prioritize your access request:

a. Subscription ID.
b. Application ID from the email that you have received

Awaiting your reply.
.

In the meantime, until the request has been approved, You can also invoke the below REST API by clicking on the TryIt option in the below article and can keep track of your request and check if the state appears as Registered:

https://learn.microsoft.com/en-us/rest/api/resources/features/list?view=rest-resources-2021-07-01&tabs=HTTP&tryIt=true&source=docs#code-try-0
.

.
Hope this helps.
Leon H 5 Reputation points

2024-01-07T18:26:47.4966667+00:00

No response from msazureopenai@microsoft.com so far.
Leon H 5 Reputation points

2024-01-07T18:27:30.3933333+00:00

No response from msazureopenai@microsoft.com so far.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-08T04:43:07.3633333+00:00

@Leon H Thanks for your reply. Could you please email me the below details over email to azcommunity[at]microsoft[dot]com with subject as "Attn: NAVBA " , so that I can ask the concerned team to prioritize your access request:

a. Subscription ID.
b. Application ID from the email that you have received

Awaiting your reply.
Leon H 5 Reputation points

2024-01-09T03:24:27.43+00:00

I tried.

Unfortunately, I get:

***The group mtmvp only accepts messages from people in its organization or on its allowed senders list, and your email address isn't on the list.

Sender not allowed.***
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-09T04:52:10.98+00:00

@Leon H I have replied to your email. Please check once you get a chance.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-15T04:16:59.0266667+00:00

@Leon H Please let me know if you had a chance to look at my below updated comment.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-17T05:50:29.4766667+00:00

@Leon H Please let me know if you had a chance to look at my below comment. Also do let me know if you have any follow-up questions on this. Awaiting your reply.

Answer 1

@Leon H I had reached out to the Product Group team in the background to discuss this requirement and shared your subscription details with them.
I have got a reply from them. You need to wait to receive a decision email from the gating team (Cognitive Services Gating Support csgate@microsoft.com) .
Additionally, there is no guarantee that your request will be approved for an application. Please keep in mind, EastUS is the most congested region, so it may be some time before we can grant any new quota or availability to customers.
.

If you need the resource to be in the US region, you should consider other US regions.
.
We appreciate your patience on this and Apologies for the inconvenience caused..
.
For the model gpt-4 (1106-preview), the closest available region to South Carolina, USA would be East US 2.
For the model gpt-4 (0613), the closest available region to South Carolina, USA would be Canada East.
.
Also in the meantime, if your request for East US gets approved, you can expect an email from Cognitive Services Gating Support csgate@microsoft.com or Microsoft Azure OpenAI <msazureopenai@microsoft.com> . Unfortunately, there is no ETA on when this would be approved considering its high in demand and most congested region.
**
Please do not forget to "Accept the answer” and “up-vote” so that this information can be beneficial to other community members.

navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-15T04:18:02.9933333+00:00

@Leon H Please let me know if you had a chance to look at my above updated comment.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-17T05:50:46.2133333+00:00

@Leon H Please let me know if you had a chance to look at my above comment. Also do let me know if you have any follow-up questions on this. Awaiting your reply.

Share via

GPT-4 Models Availability in Azure

1 answer

Your answer