Determine whether Azure OpenAI model deployments are utilizing CPU or GPU resources?

Chakaravarthi Rangarajan Bhargavi 1,200 Reputation points MVP
2023-09-14T01:52:29.4466667+00:00
  1. Are Azure OpenAI models individually hosted in dedicated infrastructure or do they share a common infrastructure within Microsoft?
  2. How can we ensure consistent performance and responsiveness for Azure OpenAI-based applications, given that we lack control over the selection of the hosting hardware?

Thanks in advance!

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
0 comments No comments
{count} votes

Answer accepted by question author
  1. Ramr-msft 17,836 Reputation points
    2023-09-15T10:24:41.3766667+00:00

    @Chakaravarthi Rangarajan Bhargavi Thanks for the question, We cannot provide more details around this. Our architecture is protected/sensitive property of Microsoft. We don't disclose technical implementations of our Azure services as we could inadvertently introduce vulnerabilities and potential exploitation.

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.