Help me understand security

Question

When I use Azure Open AI Services, am I getting my own "copy" of a model?

Im concerned about using Azure Open AI services with confidential or sensitive business data. I've read a couple docs but not getting a clear answer. I do see "deploy your model" so it seems like the model is within our own resource group and no one else has access to that specific model?

When I spin up a model, where does data actually flow when I make an API call? To my own copy of the model that I control or to some "central" server where other requests are going too.

Additionally, what is actually happening when I fine-tune a model? Is that my own "copy" of the model under my Azure account?

Answer 1

Ashwin Kadaru Greetings & Welcome to Microsoft Q&A forum!

When I use Azure Open AI Services, am I getting my own "copy" of a model?

When you use Azure Open AI Services, you are not getting your own "copy" of a model. Instead, you are using a pre-trained model provided by OpenAI. However, you can fine-tune the model using your own data to create a custom version of the model that is tailored to your specific needs. See Create a resource and deploy a model using Azure OpenAI for more details.

Im concerned about using Azure Open AI services with confidential or sensitive business data. I've read a couple docs but not getting a clear answer. I do see "deploy your model" so it seems like the model is within our own resource group and no one else has access to that specific model?

I understand that you have already checked Azure OpenAI data, privacy, and security guide.

Microsoft takes data privacy and security very seriously, and has implemented measures to ensure that personally identifiable information (PII) is not shared with OpenAI during the usage of Azure OpenAI Service. The same has been mentioned in the FAQs as well.

When you deploy your model to Azure OpenAI services, it is deployed within your own resource group and no one else has access to that specific model unless you explicitly grant them access. This means that your data and models are kept private and secure.

In addition, Azure OpenAI services provides a number of security features to help protect your data and models. For example, you can use Azure Key Vault to securely store and manage your keys and secrets, and you can use Azure Active Directory to manage access to your resources.

When I spin up a model, where does data actually flow when I make an API call? To my own copy of the model that I control or to some "central" server where other requests are going too.

When you spin up a model in Azure OpenAI services, the data flows to your own copy of the model that you control. When you make an API call to your model, the data is sent to your model instance, which is running in your own resource group.

Additionally, what is actually happening when I fine-tune a model? Is that my own "copy" of the model under my Azure account?

When you fine-tune a model, you are creating a new version of the pre-trained model that is tailored to your specific needs. This new version is stored in Azure Storage in the same region, encrypted at rest, and logically isolated with your Azure subscription and API credentials. This means that it is your own "copy" of the model under your Azure account.

You can also find more information about Microsoft's data privacy and security policies on the Microsoft Trust Center.

Hope this helps. Do let us know if you have any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.