Creating Azure OpenAI in Private Organization.

Question

Is it Possible to Create my own OpenAI in my own Private Organisation. Like, Azure Cognitive Services Container Support. it is like on-prem. I have some Sensitive data that i dont need to share with microsoft also.

Answer 1

Hello Sudhakar P,

Welcome to the Microsoft Q&A and thank you for posting your questions here.

I could understand that you would like to create your own OpenAI for your Private Organization and for content privacy is a concern.

It is absolutely possible to create your own OpenAI-like service within your private organization, similar to Azure Cognitive Services Container Support. There are three methods in my mind right now as it's listed below:

1. You can use Azure AI Containers to ensure that your data remains within your organization's on-premises infrastructure, and this methos addresses compliance and security concerns. https://learn.microsoft.com/en-us/azure/ai-services/cognitive-services-container-support
2. You can build a Private ChatGPT Interface using Azure OpenAI and other Azure services which can help your prompts and ensure data are not used to train the large language model and remain secure within your organization. https://techcommunity.microsoft.com/t5/azure-architecture-blog/building-a-private-chatgpt-interface-with-azure-openai/ba-p/3869522
3. Azure OpenAI Private Endpoints is another setup that allows you to connect securely to Azure OpenAI services while keeping your sensitive data private. https://techcommunity.microsoft.com/t5/azure-architecture-blog/azure-openai-private-endpoints-connecting-across-vnet-s/ba-p/3913325

Use the link provided to read more.

I hope this is helpful! Do not hesitate to let me know if you have any other questions.

** Please don't forget to close up the thread here by upvoting and accept it as an answer if it is helpful ** so that others in the community facing similar issues can easily find the solution.

Best Regards,

Sina Salam