Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
1,049 questions
Determine whether Azure OpenAI model deployments are utilizing CPU or GPU resources?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 16%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECR%3C/text%3E%3C/svg%3E)
Chakaravarthi Rangarajan Bhargavi
205
Reputation points
- Are Azure OpenAI models individually hosted in dedicated infrastructure or do they share a common infrastructure within Microsoft?
- How can we ensure consistent performance and responsiveness for Azure OpenAI-based applications, given that we lack control over the selection of the hosting hardware?
Thanks in advance!
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 11%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERM%3C/text%3E%3C/svg%3E)
Ramr-msft 14,751 Reputation points2023-09-15T10:24:41.3766667+00:00 @Chakaravarthi Rangarajan Bhargavi Thanks for the question, We cannot provide more details around this. Our architecture is protected/sensitive property of Microsoft. We don't disclose technical implementations of our Azure services as we could inadvertently introduce vulnerabilities and potential exploitation.
Sign in to comment