Azure OpenAI Service vs. OpenAI

Question

Azure OpenAI Service vs. OpenAI

Philip Chung 65

Is the Azure OpenAI Service completely separate from OpenAI (the company) from a data governance/privacy perspective? If data is submitted to the Azure OpenAI Service, does the data always remain within Microsoft Azure or is it passed to OpenAI at any time?

I am trying to understand if Azure OpenAI Service is reliant on passing data to OpenAI or if the Azure OpenAI Service can be considered a re-implementation of OpenAI's models securely packaged within the Azure environment with no reliance on OpenAI (the company) for model fine-tuning or inference.

VasaviLankipalle-MSFT 18,676 Reputation points Moderator

2023-03-18T03:46:42.93+00:00

Hi @Philip Chung , we received your feedback that the answer provided on the thread was not helpful.

Kindly let us know what we could have done better to improve the answer and make your engagement experience good. We are here to help you and strive to make your experience better and greatly value your feedback.

As mentioned earlier, the data submitted to the Azure OpenAI Service remains encrypted at rest.

If you wish, you may re-surveying/rating for the engagement you received on the thread. Your feedback is very important to us.

Looking forward to you reply. Much appreciate your feedback!

Regards,
Vasavi
Tingting Wang 0 Reputation points

2023-04-14T09:55:35.8266667+00:00

Hi I have a follow up question. Is it a standalone instance that runs in my Azure environment? Is it just a different way to use the same API that everyone else uses? Are the contents of the queries sent to Azure API treated differently from the other API? This is what I am trying to learn from
Thibaud TRICHARD 5 Reputation points

2023-07-03T15:43:28.3666667+00:00

Hello, I have a complementary question. I used to use the native API of OpenAI for my app. I shifted on Azure but the result is dramatically different.

I read more about the OpenAI API on Azure and it says it uses the same models but the results on the OpenAI API on Azure is far below the output I had previously with the exact same prompt.

Do you have any idea why ?

Accepted answer

0 additional answers

Your answer

VasaviLankipalle-MSFT 18,676 Reputation points Moderator

2023-03-18T03:46:42.93+00:00

Hi @Philip Chung , we received your feedback that the answer provided on the thread was not helpful.

Kindly let us know what we could have done better to improve the answer and make your engagement experience good. We are here to help you and strive to make your experience better and greatly value your feedback.

As mentioned earlier, the data submitted to the Azure OpenAI Service remains encrypted at rest.

If you wish, you may re-surveying/rating for the engagement you received on the thread. Your feedback is very important to us.

Looking forward to you reply. Much appreciate your feedback!

Regards,
Vasavi
Tingting Wang 0 Reputation points

2023-04-14T09:55:35.8266667+00:00

Hi I have a follow up question. Is it a standalone instance that runs in my Azure environment? Is it just a different way to use the same API that everyone else uses? Are the contents of the queries sent to Azure API treated differently from the other API? This is what I am trying to learn from
Thibaud TRICHARD 5 Reputation points

2023-07-03T15:43:28.3666667+00:00

Hello, I have a complementary question. I used to use the native API of OpenAI for my app. I shifted on Azure but the result is dramatically different.

I read more about the OpenAI API on Azure and it says it uses the same models but the results on the OpenAI API on Azure is far below the output I had previously with the exact same prompt.

Do you have any idea why ?

Answer 1

VasaviLankipalle-MSFT 18,676 Moderator

Hi @Philip Chung , Thanks for using Microsoft Q&A Platform.

The data submitted to the Azure OpenAI Service remains within Microsoft Azure and is not passed to OpenAI (the company) for model predictions. Azure has sole control and governance of the data and OpenAI. The Azure OpenAI service automatically encrypts any data that is persisted to the cloud, including training data and fine-tuned models. This encryption helps protect the data and ensures that it meets organizational security and compliance requirements. The article provides further details on how Azure OpenAI handles the encryption of data at rest https://learn.microsoft.com/en-us/azure/cognitive-services/openai/encrypt-data-at-rest

Please refer to the article that explains how data that is provided to the Azure OpenAI service is handled: https://learn.microsoft.com/en-us/legal/cognitive-services/openai/data-privacy?context=%2Fazure%2Fcognitive-services%2Fopenai%2Fcontext%2Fcontext

Although Azure OpenAI was designed to meet data protection, privacy, and security standards, it is the customer's responsibility to use the technology in compliance with applicable laws and regulations and in a manner that aligns with their specific business needs.

I hope this helps. Let me know if you need any more information.
Regards,
Vasavi

-Please kindly accept the answer and vote 'Yes' if you feel helpful to support the community, thanks.

Philip Chung 65 Reputation points

2023-03-18T03:49:20.6766667+00:00

This does not answer my question. I want to know whether data passed to OpenAI Service means that Azure will pass the data off to OpenAI (the company) to make model predictions, or if Azure has sole control and governance of the data and OpenAI (the company) is not involved at all. The data security and privacy leaders in my organization are very interested in this distinction.
VasaviLankipalle-MSFT 18,676 Reputation points Moderator

2023-03-18T04:27:37.74+00:00
Hi Philip Chung,

The data submitted to the Azure OpenAI Service remains within Microsoft Azure and is not passed to OpenAI (the company) for model predictions. Azure has sole control and governance of the data and OpenAI.

If you go through this you will understand as Azure OpenAI service is under Microsoft GDPR (General Data Protection Regulation) for privacy rights, information security, and compliance. you can learn more about it here: https://learn.microsoft.com/en-us/legal/gdpr

How is data retained and what Customer controls are available?

The Azure OpenAI Service allows customers to upload training data for fine-tuning models, which is stored in Azure Storage and can be deleted by the user. Fine-tuned models are also stored in Azure Storage, encrypted and logically isolated, and can also be deleted by the user. Requests and responses data are temporarily stored for up to 30 days, encrypted, and only accessible to authorized engineers for specific purposes such as debugging, investigating abuse, or improving content filtering.

To know more information about data retention and customer controls in the Azure OpenAI data privacy documentation: https://learn.microsoft.com/en-us/legal/cognitive-services/openai/data-privacy#how-is-data-retained-and-what-customer-controls-are-available

To learn more about Microsoft's privacy and security commitments visit the Microsoft Trust Center.
I hope this helps.

Please re-surveying/rating for the engagement you received on the thread. Kindly accept he answer. Your feedback is very important to us.

Looking forward to you reply. Much appreciate your feedback!

Share via

Azure OpenAI Service vs. OpenAI

0 additional answers

Your answer