Private endpoint for azure OpenAI

Question

Hello, I am trying to build a private environment. But i always get an error. Could you guide me on how to make a private environment?

Answer 1

@Somas Litler Thanks for reaching out to us, you can set the Azure OpenAI service networking by allowing access from the Selected Networks and Private Endpoints section in the Azure portal.

If you use Azure Management REST API, you can set networkAcls.defaultAction as Deny

...
"networkAcls": {
    "defaultAction": "Deny",
    "ipRules": [
        {
            "value": "4.155.49.0/24"
        }
    ]
},
"privateEndpointConnections": [],
"publicNetworkAccess": "Enabled"
...

To use Azure OpenAI Studio, you cannot set publicNetworkAccess as Disabled, because you need to add your local IP to the IP rules, so Azure OpenAI Studio can call the Azure OpenAI API for both ingestion and inference from your browser.

More information please refer to below document -

https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/use-your-data-securely#inbound-security-networking

I hope this helps.

Regards,

Yutong