Noisy Neighbor Problem: Managing 2 Azure OpenAI Resources within the Same Subscription

Question

Considering this, which reports the OpenAI resource limit per region as 30, do I still face the Noisy Neighbor Problem if I create two separate Azure OpenAI resources (within the same subscription), each with a deployment of GPT-4 in the same region?

Answer 1

Hi @Leonardo
Welcome to Microsoft Q&A! Thanks for posting the question.

In my opinion, you may face the Noisy Neighbor Problem even if you create two separate Azure OpenAI resources within the same subscription, each with a deployment of GPT-4 in the same region.

The Noisy Neighbor Problem occurs when multiple users or applications share the same physical hardware resources, such as CPU, memory, and network bandwidth. In this case, even if you have two separate Azure OpenAI resources, they may still be sharing the same physical hardware resources in the same region. Also, as per the documentation, this means you can assign up to 20K TPM to each deployment or distribute them differently as long as the total does not exceed 40K TPM if you are deploying in the North Central US, Australia East, East US 2, Canada East, Japan East, UK South, Sweden Central, Switzerland North regions.

Thanks

Saurabh