Hello,
Thanks for reaching out to us, you can set it directly in Azure OpenAI Studio deployment as below screenshot -
Alternatively, you can enable it programmatically with Azure CLI's az rest
:
Replace the {subscriptionId}
, {resourceGroupName}
, {accountName}
, and {deploymentName}
with the relevant values for your resource. In this case, accountName
is equal to Azure OpenAI resource name.
az rest --method patch --url "https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.CognitiveServices/accounts/{accountName}/deployments/{deploymentName}?2023-10-01-preview" --body '{"properties": {"dynamicThrottlingEnabled": true} }'
More details please refer to - https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/dynamic-quota
I hope this helps, please let us know how it works.
Regards,
Yutong
-Please kindly accept the answer if you feel helpful to support the community, thanks a lot.