Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,914 questions
Got "Connection error" by AzureOpenAI Chat Completions on Azure Kubernetes services, can anyone advise?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(38.4, 71%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EYJ%3C/text%3E%3C/svg%3E)
Ying, Jun
0
Reputation points
When I try to test the below Chat Completions codes, I got "Connection error".
https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/managed-identity
response = client.chat.completions.create( model="gpt-35-turbo-0125", # model = "deployment_name". messages=[ {"role": "system", "content": "You are a helpful assistant."}, {"role": "user", "content": "Does Azure OpenAI support customer managed keys?"}, {"role": "assistant", "content": "Yes, customer managed keys are supported by Azure OpenAI."}, {"role": "user", "content": "Do other Azure AI services support this too?"} ] )
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(124.80000000000001, 17%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPP%3C/text%3E%3C/svg%3E)
Pavankumar Purilla 6,290 Reputation points Microsoft External Staff2025-04-16T07:51:02.51+00:00 Hi Ying, Jun,
To troubleshoot the Connection error you're encountering with Azure OpenAI Chat Completions on Azure Kubernetes Services (AKS), I recommend testing the code first from a machine with public internet access, such as your local machine or an Azure VM outside of AKS. This will help determine if the issue is specific to your AKS environment or a more general connectivity problem with Azure OpenAI. If the code works from a machine with internet access, the next step is to verify the connectivity from your AKS environment to the Azure OpenAI endpoint.
Ensure that there are no firewall rules, network policies, or other network restrictions blocking outbound traffic from your AKS cluster. Additionally, confirm that the managed identity associated with your AKS cluster has the necessary permissions to access Azure OpenAI.
I hope this information helps. Thank you!
-
Pavankumar Purilla 6,290 Reputation points Microsoft External Staff
2025-04-17T05:44:33.1366667+00:00 Hi Ying, Jun,
Did you get any chance to check the response. Thank you! -
Pavankumar Purilla 6,290 Reputation points Microsoft External Staff
2025-04-18T02:37:16.6866667+00:00 Hi Ying, Jun,
Just following up to see if you had a chance to review the above response. Thank you!
Sign in to comment
Sign in to answer