Determine whether Azure OpenAI model deployments are utilizing CPU or GPU resources?

Chakaravarthi Rangarajan Bhargavi 205 Reputation points
  1. Are Azure OpenAI models individually hosted in dedicated infrastructure or do they share a common infrastructure within Microsoft?
  2. How can we ensure consistent performance and responsiveness for Azure OpenAI-based applications, given that we lack control over the selection of the hosting hardware?

Thanks in advance!

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
1,049 questions
{count} votes