Is it possible to know the IP addresses accessing the API endpoints of the Azure OpenAI service?

Question

Is it possible to know the IP addresses accessing the API endpoints of the Azure OpenAI service?

ai_test 5

I would like to know the IP addresses that are accessing the API endpoints in order to configure the firewall for the Azure OpenAI service.

How do I know the IP address?

1 answer

Your answer

Answer 1

VasaviLankipalle-MSFT 18,676 Moderator

Hi @ai_test , Thanks for using Microsoft Q&A Platform.

Please refer to this documentation to learn more about managing IP network rules for Cognitive Services resources: https://learn.microsoft.com/en-us/azure/cognitive-services/cognitive-services-virtual-networks?context=%2Fazure%2Fcognitive-services%2Fopenai%2Fcontext%2Fcontext&tabs=portal#managing-ip-network-rules

Additionally, https://learn.microsoft.com/en-us/azure/api-management/api-management-howto-ip-addresses

Is this something you are looking for? Please elaborate more on this.

I hope this helps.

Regards,
Vasavi

-Please kindly accept the answer and vote 'yes' if you feel helpful to support the community, thanks.

Paul Smith 30 Reputation points

2023-08-16T19:53:47.9533333+00:00

Hi, this answer does not answer anything...

Please can you give an answer, we too are having this issue.

Want to run OpenAI (GPT4) to talk to cog search, which will hold sensitive data, so naturally we want to restrict access to the search index. But the minute you put cog search behind anything OpenAI cannot talk to it, you get an upstream timeout.

The only way OpenAI can use cog search as a data source is to make the datasource publicly accessible and this is a security risk.

We have tried private endpoints for cog search, we have tried doing a dns lookup on the openai address and adding that IP as an inboud IP on cog search (but its likely not the outgoing ip)....

We could leave cog search open to public but restricted to IP but if we cant get the openai IP address for outgoing connections to datasources then we cant do that.

We have even tried running cog search through a proxy, but the address resolving inside whatever is going on inside openai will allow you to set another public endpoint but it tires to resolve only the first part up to the first dot, to a windows domain. so no help there either (we could have at least protected teh proxy)

I am at a complete loss what to do with this, and to be fair only allowing datasources from cog search that is publicly available is a huge security oversight, yes its got an API key but it needs to be behind a firewall or at least restricted to ip.....

so...

What is the public outbound IP address for openai ..... the outbound address from https://xxx-xxx-xxx.openai.azure.com, what address is it hitting cog search with (and yes ive tried the logs, dont get me started on the logs)

regards

paul

Share via

Is it possible to know the IP addresses accessing the API endpoints of the Azure OpenAI service?

1 answer

Your answer