Can't deploy any GPT-4 model - No quota is available for this model Error

Question

Can't deploy any GPT-4 model - No quota is available for this model Error

Shir Tzoref 25

Hi, I'm trying to deploy gpt-4 model, but I'm getting the following error: User's image When I'm checking the quotas, I don't see any problem (I only have deployed GPT-35-Turbo-16K model):

What can be the problem? Thanks

Chakaravarthi Rangarajan Bhargavi 1,115 Reputation points MVP

2024-01-15T02:50:05+00:00
Hi @Shir Tzoref Welcome to Microsoft Q&A. Thanks for the interesting question! Please make sure you have applied to the Azure OpenAI Service. Once approved for the Azure OpenAI Service, you will have access to GPT-4 in a few selective regions only. See below screenshot. GPT-4 and GPT-4-32k are now available to all Azure OpenAI Service customers. Availability varies by region. If you don't see GPT-4 in your region, please check back later. As mentioned in our below docs for East US- Due to high demand, availability is limited in the region.

Please check if you have created the resource under this region

More Info here. Hope this answer helps you with solution! If you have any follow-up questions, please let me know. I would be happy to answer. Regards, Chakaravarthi Rangarajan Bhargavi

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members. Thanks a lot!
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-15T05:16:42.14+00:00

@Shir Tzoref Welcome to Microsoft Q&A Forum, Thank you for posting your query here!
Adding on to the below answer, please do note that East US region is congested due to high demand. Try other regions listed in the below screenshot and let me know if that helps. If you have any follow-up questions, please let me know. I would be happy to help.
Shir Tzoref 25 Reputation points

2024-01-15T07:47:54.1333333+00:00

I applied to Azure Open AI and already got approved a week ago.
Please notice that the problem isn't GPT-4 availability, since I'm using EASTUS2 and it is available (as you can see in the picture I added) the error is about the quota.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-15T07:56:00.38+00:00

@Shir Tzoref Thanks for getting back. To increase the quota you need to fill the below form and wait for the approval:

https://aka.ms/oai/quotaincrease Additionally, there is no guarantee that your request will be approved for an application.
.
If your request for East US gets approved, you can expect an email from Cognitive Services Gating Support csgate@microsoft.com or Microsoft Azure OpenAI msazureopenai@microsoft.com . Unfortunately, there is no ETA on when this would be approved considering its high in demand and most congested region.
.
If this is a critical issue, as a workaround try deploying the service to another region.
listed in the below table:

Hope this answers.
Shir Tzoref 25 Reputation points

2024-01-15T08:20:44.68+00:00

Hi, why do I need to increase the quota? In the second picture, I added you can see I only used 120 quotas of 300.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-16T04:46:33.3266667+00:00

@Shir Tzoref Thanks for getting back. Could you please navigate to AI Studio manage section and check the quotas from there ? Also toggle the region switch and check the quoate usage if that makes any difference ?
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-17T06:10:40.9366667+00:00

@Shir Tzoref Also please try changing the model version from the deploy model section and see if that has a different result. See the below screenshot:

Awaiting your reply.
Shir Tzoref 25 Reputation points

2024-01-17T07:30:18.9066667+00:00

Hi In EastUS I'm still getting an error, but I managed to deploy the model in East Canada. Thanks
Josh Eliason 5 Reputation points

2024-01-19T23:32:44.81+00:00

Thank you for the tip about deploying in Canada East - I was able to do the same. However, I noticed if I asked the model I deployed which version of GPT it is running it responded that it's based on OpenAI's GPT-3 model (not even GPT-3.5). Do you experience the same thing?
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-20T06:19:04.93+00:00

@Josh Eliason Thanks for your question.

When I ask GPT-4 which model it's running, it tells me it's running GPT-3. Why does this happen? Azure OpenAI models (including GPT-4) being unable to correctly identify what model is running is expected behavior. Why does this happen? Ultimately, the model is performing next token prediction in response to your question. The model doesn't have any native ability to query what model version is currently being run to answer your question. To answer this question, you can always go to Azure OpenAI Studio > Management > Deployments > and consult the model name column to confirm what model is currently associated with a given deployment name. The questions, "What model are you running?" or "What is the latest model from OpenAI?" produce similar quality results to asking the model what the weather will be today. It might return the correct result, but purely by chance. On its own, the model has no real-world information other than what was part of its training/training data. In the case of GPT-4, as of August 2023 the underlying training data goes only up to September 2021. GPT-4 wasn't released until March 2023, so barring OpenAI releasing a new version with updated training data, or a new version that is fine-tuned to answer those specific questions, it's expected behavior for GPT-4 to respond that GPT-3 is the latest model release from OpenAI. If you wanted to help a GPT based model to accurately respond to the question "what model are you running?", you would need to provide that information to the model through techniques like prompt engineering of the model's system message, Retrieval Augmented Generation (RAG) which is the technique used by Azure OpenAI on your data where up-to-date information is injected to the system message at query time, or via fine-tuning where you could fine-tune specific versions of the model to answer that question in a certain way based on model version. More info here.

Accepted answer

0 additional answers

Your answer

Chakaravarthi Rangarajan Bhargavi 1,115 Reputation points MVP

2024-01-15T02:50:05+00:00

Hi @Shir Tzoref Welcome to Microsoft Q&A. Thanks for the interesting question! Please make sure you have applied to the Azure OpenAI Service. Once approved for the Azure OpenAI Service, you will have access to GPT-4 in a few selective regions only. See below screenshot. GPT-4 and GPT-4-32k are now available to all Azure OpenAI Service customers. Availability varies by region. If you don't see GPT-4 in your region, please check back later. As mentioned in our below docs for East US- Due to high demand, availability is limited in the region.

Please check if you have created the resource under this region

More Info here. Hope this answer helps you with solution! If you have any follow-up questions, please let me know. I would be happy to answer. Regards, Chakaravarthi Rangarajan Bhargavi

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members. Thanks a lot!
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-15T05:16:42.14+00:00

@Shir Tzoref Welcome to Microsoft Q&A Forum, Thank you for posting your query here!
Adding on to the below answer, please do note that East US region is congested due to high demand. Try other regions listed in the below screenshot and let me know if that helps. If you have any follow-up questions, please let me know. I would be happy to help.
Shir Tzoref 25 Reputation points

2024-01-15T07:47:54.1333333+00:00

I applied to Azure Open AI and already got approved a week ago.
Please notice that the problem isn't GPT-4 availability, since I'm using EASTUS2 and it is available (as you can see in the picture I added) the error is about the quota.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-15T07:56:00.38+00:00

@Shir Tzoref Thanks for getting back. To increase the quota you need to fill the below form and wait for the approval:

https://aka.ms/oai/quotaincrease Additionally, there is no guarantee that your request will be approved for an application.
.
If your request for East US gets approved, you can expect an email from Cognitive Services Gating Support csgate@microsoft.com or Microsoft Azure OpenAI msazureopenai@microsoft.com . Unfortunately, there is no ETA on when this would be approved considering its high in demand and most congested region.
.
If this is a critical issue, as a workaround try deploying the service to another region.
listed in the below table:

Hope this answers.
Shir Tzoref 25 Reputation points

2024-01-15T08:20:44.68+00:00

Hi, why do I need to increase the quota? In the second picture, I added you can see I only used 120 quotas of 300.
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-16T04:46:33.3266667+00:00

@Shir Tzoref Thanks for getting back. Could you please navigate to AI Studio manage section and check the quotas from there ? Also toggle the region switch and check the quoate usage if that makes any difference ?
navba-MSFT 27,540 Reputation points Microsoft Employee Moderator

2024-01-17T06:10:40.9366667+00:00

@Shir Tzoref Also please try changing the model version from the deploy model section and see if that has a different result. See the below screenshot:

Awaiting your reply.
Shir Tzoref 25 Reputation points

2024-01-17T07:30:18.9066667+00:00

Hi In EastUS I'm still getting an error, but I managed to deploy the model in East Canada. Thanks
Josh Eliason 5 Reputation points

2024-01-19T23:32:44.81+00:00

Thank you for the tip about deploying in Canada East - I was able to do the same. However, I noticed if I asked the model I deployed which version of GPT it is running it responded that it's based on OpenAI's GPT-3 model (not even GPT-3.5). Do you experience the same thing?

Answer 1

@Shir Tzoref I'm glad to see you were able to resolve your issue. Thanks for posting your solution so that others experiencing the same thing can easily reference this. Since the Microsoft Q&A community has a policy that the question author cannot accept their own answer, they can only accept answers by others, I'll repost your solution in case you'd like to Accept the answer.
.
Issue:
You are trying to deploy the gpt-4 model and getting error- No quota is available for this model
.
Resolution:
You managed to deploy the model in East Canada to workaround this issue.
**
Please 'Accept as answer' and ‘Upvote’, so that it can help others in the community looking for help on similar topics.

Share via

Can't deploy any GPT-4 model - No quota is available for this model Error

0 additional answers

Your answer