Using GPT API to utilize AzureOpenAI with in-house data in highly security-sensitive industries.

Question

I am developing a system for a client.

The client is in an industry that is very strict about security when it comes to handling data.

As such, the client is concerned about uploading data to the Azure cloud environment and including their own company data in API requests using the GPT API.

*Concerns that their own company data included in API requests will remain on the Azure cloud

They are concerned that their own company data used in the API will remain in the Azure cloud environment and be used to train AI models, leading to the leakage of their own company data.

Even if their own company data is included in API requests using the Azure GPT API, will the data included in the API request not remain on the Azure cloud if they apply for "opt out"?

Answer 1

CasperMorow Greetings & Welcome to Microsoft Q&A forum!

As such, the client is concerned about uploading data to the Azure cloud environment and including their own company data in API requests using the GPT API.

Did you check the Data, privacy, and security for Azure OpenAI Service already?

Your prompts (inputs) and completions (outputs), your embeddings, and your training data:

• are NOT available to other customers.
• are NOT available to OpenAI.
• are NOT used to improve OpenAI models.
• are NOT used to train, retrain, or improve Azure OpenAI Service foundation models.
• are NOT used to improve any Microsoft or 3rd party products or services without your permission or instruction.
• Your fine-tuned Azure OpenAI models are available exclusively for your use.

The Azure OpenAI Service is operated by Microsoft as an Azure service; Microsoft hosts the OpenAI models in Microsoft’s Azure environment and the Service does NOT interact with any services operated by OpenAI (e.g. ChatGPT, or the OpenAI API).

They are concerned that their own company data used in the API will remain in the Azure cloud environment and be used to train AI models, leading to the leakage of their own company data.

When you use Azure OpenAI Service, your data is encrypted in transit and at rest, and is stored in Microsoft Azure data centers that are compliant with various industry standards and regulations, such as ISO 27001, HIPAA, and GDPR. Microsoft also provides tools and services to help you manage and protect your data, such as Azure Key Vault and Azure Active Directory. See Azure OpenAI Service encryption of data at rest for more details.

The diagram below illustrates how your data is processed. This diagram covers several types of processing:

1. How the Azure OpenAI Service processes your prompts via inferencing to generate content (including when additional data from a designated data source is added to a prompt using Azure OpenAI on your data, Assistants, or batch processing).
2. How the Assistants feature stores data in connection with Messages, Threads, and Runs.
3. How the Batch feature processes your uploaded data.
4. How the Azure OpenAI Service creates a fine-tuned (custom) model with your uploaded data.
5. How the Azure OpenAI Service and Microsoft personnel analyze prompts and completions (text and image) for harmful content and for patterns suggesting the use of the service in a manner that violates the Code of Conduct or other applicable product terms.

Even if their own company data is included in API requests using the Azure GPT API, will the data included in the API request not remain on the Azure cloud if they apply for "opt out"?

The data store where prompts and completions are stored is logically separated by customer resource (each request includes the resource ID of the customer’s Azure OpenAI resource). A separate data store is located in each geography in which the Azure OpenAI Service is available, and a customer’s prompts and generated content are stored in the Azure Geography where the customer’s Azure OpenAI service resource is deployed, within the Azure OpenAI service boundary.

I would request you, please check the FAQ documentation Azure OpenAI Service frequently asked questions for more details.

Do let me know if that helps or have any further queries.