Share via

How to use OpenAI and LLM flows hosted in Azure to run in other secure environments?

Anis Sahnoun 0 Reputation points
2024-03-25T12:31:12.45+00:00

I have OpenAI and LLM flows with vector index all hosted in my Azure environment. How can I run the flows on other environments that require complete security and privacy? does date need to be shared to the azure environment?

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
Exchange | Hybrid management
Exchange | Hybrid management
The administration of a hybrid deployment that connects on-premises Exchange Server with Exchange Online, enabling seamless integration and centralized control.
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. YutongTie-MSFT 54,011 Reputation points Moderator
    2024-03-25T20:32:31.65+00:00

    @Anis Sahnoun

    Thanks for reaching out to us, not pretty sure what do you mean by running your Azure OpenAI model in other environments?

    But if you deploy your model in private endpoint it will be secure enough from some points. By establishing a private link, Azure OpenAI Private Endpoints provide a secure and efficient channel for transmitting data between your infrastructure and the OpenAI service, mitigating potential security vulnerabilities associated with traditional public endpoints. Please check on this blog if that is what you want - https://techcommunity.microsoft.com/t5/azure-architecture-blog/azure-openai-private-endpoints-connecting-across-vnet-s/ba-p/3913325

    thumbnail image 1 of blog post titled Azure OpenAI Private Endpoints: Connecting Across VNET’s

    Please let us know if the process is not what you are looking for, we are happy to discuss further for this case.

    Regards,

    Yutong

    1 person found this answer helpful.
    0 comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.