Azure OpenAI deployment quotas

Ashik Salim 75

Hi,

We have a Azure OpenAI resource in South Central US. We are currently trying to move recreate this resource in East US region since that is where the rest of our resources are hosted. Currently I have created OpenAI resource in East US, however it won't let me make any deployments. I deleted a deployment for ada embedding model from the South Central US to free up quota, but the resource in East US still won't let me make a new deployment for that model.

Is there any regional restriction to where I can deploy models? I don't need an increase in quota, I just need to free up existing quota so I can create deployments in new region. What should I do to be able to reclaim existing quota?

Accepted answer

Vince Kolb 195 Reputation points

2023-07-13T19:42:06.7866667+00:00

see response from Carlos Omar Toscano Sosa for question below:

https://learn.microsoft.com/en-us/answers/questions/1321245/only-owner-has-quotas-in-azure-open-ai-service?page=1&orderby=Helpful&comment=answer-1285374#newest-answer-comment
Please sign in to rate this answer.

1 person found this answer helpful.
Ashik Salim 75 Reputation points

2023-07-14T10:35:33.5533333+00:00

Unfortunately that'll be some lengthy conversations with IT to explain why we need subscription level access, so I think I'll just forward this to IT and let them raise a support request with Azure. Upvoting in case it helps others with the same problem.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

1 additional answer

AshokPeddakotla-MSFT 35,766 Reputation points

2023-07-06T08:08:56.9233333+00:00

Ashik Salim Greetings & Welcome to Microsoft Q&A forum!

Is there any regional restriction to where I can deploy models?

Yes, there is a regional restriction depends on the model which you are going to deploy.

Please see Model Summary table and region availability for more details.

I don't need an increase in quota, I just need to free up existing quota so I can create deployments in new region. What should I do to be able to reclaim existing quota?

Regarding your issue with creating a new deployment model in the East US region, it's possible that the quota for that model is still being used in the South Central US region, even though you deleted the deployment. This could be due to a delay in the system updating the quota usage information.

To check if this is the case, you can go to the Azure portal and navigate to your Azure OpenAI resource in the South Central US region. From there, go to the "Usage + quotas" tab and check if the quota for the ada embedding model has been freed up. If it hasn't, you may need to wait a little longer for the system to update the quota usage information.

If the quota has been freed up, you should be able to create a new deployment for the ada embedding model in the East US region. See Manage Azure OpenAI Service quota for more details.

Hope this helps.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Please sign in to rate this answer.
Ashik Salim 75 Reputation points

2023-07-06T10:49:10.9633333+00:00

@AshokPeddakotla-MSFT Thank you for your response. Our quotas page does not look like the screenshot you posted.

We also have a gpt-4 deployment that doesn't even show up on this page. gpt-4 is also listed as not supported on South Central US in the model region compatibility doc you shared.

In an attempt to free up quota I tried deleting the embedding deployment, I tried reducing the quota for text-davinci-003. Neither has worked. Not only that I can no longer increase the quota back to its original value, the slider now only goes up to the new value I set. On top of that I also cannot create any deployments of any model, whatever model I try to deploy it says no quota available.

So in effect we have lost the embedding deployment, and have lost some quota on existing models, and cannot create any deployments for any model in any region. I'm not deleting or adjusting any quotas further as the gpt-4 deployment is crucial to us. Clearly there is something wrong with the quotas on this subscription. Please advise.

Alex Castillo 5 Reputation points

2023-07-06T16:31:22.4966667+00:00

I have free quotas, and in east us cant create any deployment, I guess that is the same in any other region. I just started with that issue yesterday

AshokPeddakotla-MSFT 35,766 Reputation points

2023-07-06T16:32:02.2+00:00

Ashik Salim I am checking on this issue internally and update you as earliest. Appreciate your time and patience.

Lexington Griffith 0 Reputation points

2023-07-06T17:23:28.41+00:00

We are experiencing the same exact issue -- we've submitted a ticket but any resolution would be appreciated.

VasaviLankipalle-MSFT 18,386 Reputation points

2023-07-06T22:33:47.3833333+00:00

Hello @Ashik Salim , could you please check whether you have the reader permission set on the subscription level. If you don't have the permission, try setting it and see if that helps.

Usually if the resource group was deleted in the past 48hours, then you will need to purge the soft deleted resource. https://learn.microsoft.com/en-us/azure/cognitive-services/manage-resources?tabs=azure-portal#purge-a-deleted-resource

VasaviLankipalle-MSFT 18,386 Reputation points

2023-07-06T22:35:14.69+00:00

Hello @Ashik Salim , could you please check whether you have the reader permission set on the subscription level. If you don't have the permission, try setting it and see if that helps.

Usually if the resource group was deleted in the past 48hours, then you will need to purge the soft deleted resource. https://learn.microsoft.com/en-us/azure/cognitive-services/manage-resources?tabs=azure-portal#purge-a-deleted-resource

Ashik Salim 75 Reputation points

2023-07-07T01:22:53.2633333+00:00

@VasaviLankipalle-MSFT I don't know the details of how subscription permissions work, I'm a dev. These are my current permissions:

I will forward your comment to the admin on my side. Please note though that these are deployments within OpenAI resource, so the classical RBAC permissions don't apply to this AFAIK. The model deployments were originally created by me, and now I can't make or adjust deployments. My permissions haven't changed so I don't see why it would be different now.

I have also checked the deleted resources section, it reports empty. Either way it has been more than 48 hours now.

AshokPeddakotla-MSFT 35,766 Reputation points

2023-07-11T17:07:52.97+00:00

Ashik Salim Sincere apologies for the delayed response.

As Vasavi called out, please check the permissions which you have on the subscription level.

The model deployments were originally created by me, and now I can't make or adjust deployments. My permissions haven't changed so I don't see why it would be different now.

I understand that, you did a deployment earlier and your permissions didn't change.

API pulls current usage of OpenAI in the subscription. It requires subscription level read permission (microsoft.cognitiveservices/locations/usages/read).

Suggest you to kindly check if the permissions has changed now. Generally, OpenAI Contributor role should be sufficient permissions to deploy OpenAI models.

If you are unsure whether you have the required reader permission, you can follow these steps to check and add your self with required permissions.

Go to the Azure portal and navigate to your Azure OpenAI resource.

Click on "Access control (IAM)" in the left-hand menu.

Click on "Add" and select "Add role assignment".

In the "Add role assignment" pane, select the "Contributor" role and search for your user account.

Click on "Add" to assign the Contributor role to your user account.

Please see below screenshot for more details on how to check the permissions.

Also, along with read, check if "write" permission assigned to your account. This permission allows you to create and update deployments for your Azure OpenAI resource.

For using specific actions you can lookup the list of actions available and add them to a custom role as well.

I hope this helps you resolve the issue which you are facing. Please let us know if you have any further queries. Happy to assist you.

Vince Kolb 195 Reputation points

2023-07-12T13:54:06.7766667+00:00

I am having similar issues not seeing any default Quotas for newly created OpenAI Resource in EAST US region. would like to know if the latest response from Ashok resolved your issue

Ashik Salim 75 Reputation points

2023-07-12T15:54:59.3933333+00:00

@AshokPeddakotla-MSFT I have reached out to internal IT and secured the necessary permissions:

However, I still cannot edit quotas for existing deployment, I cannot create a new deployment, nor does the "Quotas" screen have any useful info. Essentially the role assignment has made no difference.

So to reiterate, as well as @Vince Kolb, the issue has not been fixed.

Vince Kolb 195 Reputation points

2023-07-12T16:10:17.65+00:00

In another similar post, it was mentioned that Contributor role wasn't enough, even though support response said it should be. they resolved it, for the time being, by assigning "owner" level permissions to the user to finally be able to deploy openai models. not a long term solution for anyone by any means
I am still waiting to find out if we can advance our development with just the mentioned Contributor role permissions first

Vince Kolb 195 Reputation points

2023-07-13T14:14:21.2833333+00:00

we attempted allowing "owner" role at the Azure OpenAI resource level with no change in results. we know that the "owner" of the Azure Subscription can see our Quotas and create deployments.

So as of right now, only the "owner" of the overall Azure subscription in our organization can perform deployments.

Really, really need to have the Contributor role work as expected!!!

AshokPeddakotla-MSFT 35,766 Reputation points

2023-07-13T16:49:58.6366667+00:00

Ashik Salim Since the suggestions provided are not helpful to you, request you to contact support for further assistance. Support team would be able to check in the backend and investigate your issue further. I suggest you, please file a support request @ https://aka.ms/azsupt? If you do not have a support plan let us know.

Also, as Vince suggested, check if "owner" role resolves the issue.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Azure OpenAI deployment quotas

1 additional answer

Your answer