How to know azure open ai model deployments stored in cpu or gpu?

Anonymous
2023-08-30T06:08:46.1233333+00:00

Please share the architecture of azure open ai model deployments and how to know that model deployments will stored in which hardware configuration**(CPU or GPU details) ?**

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,106 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
3,645 questions
{count} vote

1 answer

Sort by: Most helpful
  1. romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator
    2023-08-30T12:09:57.6933333+00:00

    @Anonymous The information about the exact infrastructure used for model hosting and deployment is confidential and is not disclosed in public domain. To summarize, deployments use both CPU and GPU depending on the type of model used for deployments. Thanks!!

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    2 people found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.