If you do a model deployment with Cognitive Services (Azure OpenAI), is this model deployed on a dedicated instance? So is the instance only assigned to your organisation or is there other data from organisation processed on the VM as well?

Berend Jutte 1 Reputation point
2023-05-01T14:34:51.27+00:00

When you deploy a model with Cognitive Services, do you get a dedicated instance or do you share the instance with other organisations?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,197 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,893 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. romungi-MSFT 46,746 Reputation points Microsoft Employee
    2023-05-02T15:16:16.73+00:00

    @Berend Jutte Currently, model deployments do not have an option to use dedicated compute for deployments. Once a model deployment (consisting of a customer's fine-tuned model or a base model endpoint) is provisioned in a customer's Azure OpenAI resource data is stored in Azure Storage, encrypted at rest by Microsoft Managed keys, within the same region as the resource and logically isolated with their Azure subscription and API Credentials.

    For data in transit, you can configure virtual networks with your Azure OpenAI resource to secure your Cognitive Services accounts to a specific subset of networks.

    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.