Securing access for LLAMA2 to private network

imgkj 45 Reputation points
2024-01-10T07:09:31.2766667+00:00

I have deployed llama2 and want to restrict it's access to internal networks only. Just wanted to know if there are any preconfigured endpoints or network configurations for llama2 model? Or will i need to follow the same configuration as other azure openai gpt models such as gpt4 and gpt3.5 and create the private endpoints for llama2 model resources.

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,621 questions
Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
3,096 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Evgeny Grishchenko 486 Reputation points
    2024-01-10T10:22:59.0933333+00:00

    Your workspace first must be created with private access. Check this link.

    0 comments No comments

  2. AshokPeddakotla-MSFT 35,926 Reputation points
    2024-01-10T10:30:58.9866667+00:00

    Gaurav Kumar Greetings!

    AFAIK, There are no preconfigured endpoints or network configurations for Llama2 model specifically. However, you can follow the same configuration as other Azure OpenAI GPT models such as GPT4 and GPT3.5 and create the private endpoints for Llama2 model resources.

    Once you have created the private endpoint, you can use it to access your Llama2 model.

    I would suggest you, check How to configure a private link for Azure AI for more details.

    Do let me know if that helps or have any further queries.


    If the response helped, please do click Accept Answer and Yes for was this answer helpful.

    Doing so would help other community members with similar issue identify the solution. I highly appreciate your contribution to the community.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.