How to know azure open ai model deployments stored in cpu or gpu?

Sathyadharani K 5 Reputation points

Please share the architecture of azure open ai model deployments and how to know that model deployments will stored in which hardware configuration**(CPU or GPU details) ?**

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
977 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
1,669 questions
{count} vote

1 answer

Sort by: Most helpful
  1. romungi-MSFT 38,306 Reputation points Microsoft Employee

    @Sathyadharani K The information about the exact infrastructure used for model hosting and deployment is confidential and is not disclosed in public domain. To summarize, deployments use both CPU and GPU depending on the type of model used for deployments. Thanks!!

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    2 people found this answer helpful.