Custom Vision SDK - Increasing Quota for Requests Per Second

Question

The Custom Vision SDK is being used, but the limit of 10 requests per second is frequently being exceeded, resulting in errors like:

Failed to train project: Error: Requests to the TrainProject Operation under Custom_Vision_Training_3.4-preview have exceeded call rate limit of your current Custom_Vision.Training S0 pricing tier. Please retry after 1 second. Please contact Azure support service if you would like to further increase the default rate limit.

Assistance is needed to urgently increase this request limit.

Answer 1

Hello

If you're encountering rate limit errors while using the Azure Custom Vision SDK, particularly exceeding the default limit of 10 requests per second (TPS) on the S0 (Standard) tier, you can request an increase in this quota by submitting a support request through the Azure portal.

Steps to Request a TPS Increase:

1. Sign in to the Azure Portal: Navigate to https://portal.azure.com and sign in with your Azure account credentials.
2. Select Your Custom Vision Resource: In the Azure portal, locate and select the Custom Vision resource for which you want to increase the TPS limit.
3. Initiate a New Support Request:
   • In the resource's menu, under the "Support + troubleshooting" section, click on "New support request".
   Fill Out the Support Request Form: Issue Type: Select "Service and subscription limits (quotas)".

     **Subscription**: Choose the subscription associated with your Custom Vision resource.
   
        **Quota Type**: Select **"Custom Vision"**.
   
           **Details**: Provide a clear and concise explanation of your request. For example:[Microsoft Learn+2Microsoft Learn+2Microsoft Learn+2](https://learn.microsoft.com/en-us/answers/questions/2258779/request-custom-vision-rate-limit-increae?utm_source=chatgpt.com)[Microsoft Learn+9Microsoft Learn+9Microsoft Learn+9](https://learn.microsoft.com/en-us/answers/questions/2280548/custom-vision-sdk-increasing-quota-for-requests-pe?utm_source=chatgpt.com)
   
           > "We are experiencing throttling issues due to the current TPS limit of 10 on our Custom Vision S0 tier. Our application requires a higher throughput to function optimally. We kindly request an increase in the TPS limit to [desired TPS], along with any necessary guidance on scaling our service to accommodate this increase."
   
           **Submit the Request**: Review your information and submit the support request.[Microsoft Learn+1Microsoft Learn+1](https://learn.microsoft.com/en-us/answers/questions/2258779/request-custom-vision-rate-limit-increae?utm_source=chatgpt.com)
   

Additional Recommendations:

Implement Retry Logic: Incorporate exponential backoff and retry mechanisms in your application to handle transient failures and rate limit errors gracefully.

Monitor Metrics: Use Azure Monitor to track the performance and usage metrics of your Custom Vision resource. This can help you identify patterns and optimize your application's interaction with the service.

Gradual Scaling: If you're planning to increase your application's request rate, do so gradually to allow the service to scale accordingly and avoid sudden spikes that could lead to throttling.Microsoft Learn

For more detailed information on Custom Vision Service limits and quotas, you can refer to the official documentation: Limits and quotas - Custom Vision Service.Microsoft Learn+1Microsoft Learn+1

If you encounter any issues during this process or need further assistance, feel free to reach out through the Azure support channels.

Best Regards,

Jerald Felix