For Azure Cognitive Search with Azure OpenAI Service, are the user queries/prompts sent to OpenAI or does Microsoft process them?

Question

For Azure Cognitive Search with Azure OpenAI Service, are the user queries/prompts sent to OpenAI or does Microsoft process them? Are the user prompts encrypted in transit and at rest?

I just want to know if the privacy of the queries are protected.

Thanks!

Answer 1

Hi @Kenneth Tin Fu Cheung , thanks for the question.

When using Azure Cognitive Search with the Azure OpenAI service, the Azure OpenAI Service processes he user queries/prompts, not OpenAI.

Here are some key points about data privacy and security that can be found in the Azure Data, privacy, and security for Azure OpenAI Service documentation about user's queries/prompts:

Your prompts (inputs) and completions (outputs), your embeddings, and your training data:

• are NOT available to other customers.
• are NOT available to OpenAI.
• are NOT used to improve OpenAI models.
• are NOT used to improve any Microsoft or 3rd party products or services.
• are NOT used for automatically improving Azure OpenAI models for your use in your resource (The models are stateless, unless you explicitly fine-tune models with your training data).
• Your fine-tuned Azure OpenAI models are available exclusively for your use.

The Azure OpenAI Service is fully controlled by Microsoft; Microsoft hosts the OpenAI models in Microsoft’s Azure environment and the Service does NOT interact with any services operated by OpenAI (e.g. ChatGPT, or the OpenAI API).

Please also see the Microsoft Products and Services Data Protection Addendum, which governs data processing by the Azure OpenAI Service except as otherwise provided in the applicable Product Terms.

Hope that helps.

-Grace