Accessing Azure OpenAI from Azure VM (unix) is not working. However, i can access from AzureopenAI from local PC. have restriction to not update the network. Note both are same azure MSDN account. Getting Https 500 error. checked 443 port is working

Question

Accessing Azure OpenAI from Azure VM (unix) is not working. However, i can access from AzureopenAI from local PC. have restriction to not update the network. Note both are same azure MSDN account. Getting Https 500 error. checked 443 port is working

VinothKumarR 0

User's image

Get API seems working now but POST api is getting error now. sample python connector is connecting and getting output but post API getting error

Anusree Nashetty 4,785 Reputation points Microsoft External Staff Moderator

2025-06-26T22:14:36.4133333+00:00
Hi VinothKumarR,

Ensure Azure Linux Agent (waagent) is up and running. Restart and verify the agent inside the VM: https://learn.microsoft.com/en-us/troubleshoot/azure/virtual-machines/linux/linux-azure-guest-agent

Ensure the correct endpoint (e.g., https://<resource-name>.openai.azure.com) and API key are used. https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#authentication

If using Private Endpoints, ensure DNS is correctly resolving to the private IP:

nslookup <your-resource-name>.openai.azure.com

A 500 error implies there might be an issue with the server-side or how the request is formed. If you're using any specific libraries or SDKs for making the requests, confirm they are up-to-date and compatible with Azure OpenAI.

If you have any further queries, let me know.

VinothKumarR 0

following connection check code work in Azure VM

import os
from openai import AzureOpenAI

endpoint = "https://testdemo-oct13.openai.azure.com/"
model_name = "gpt-4"
deployment = "gpt-4"

subscription_key = "****masked***"
api_version = "2024-12-01-preview"

client = AzureOpenAI(
    api_version=api_version,
    azure_endpoint=endpoint,
    api_key=subscription_key,
)

response = client.chat.completions.create(
    messages=[
        {
            "role": "system",
            "content": "You are a helpful assistant.",
        },
        {
            "role": "user",
            "content": "I am going to Paris, what should I see?",
        }
    ],
    max_tokens=4096,
    temperature=1.0,
    top_p=1.0,
    model=deployment
)

print(response.choices[0].message.content)

But the below actual script is not working... thought it works from calling from local PC




assistant = client.beta.assistants.create(
            name="TalentPro Vector Search Assistant",
            instructions=ASSISTANT_INSTRUCTIONS,
            model=assistant_deployment,
            tools=get_function_tools()

Manas Mohanty 6,285 Reputation points Microsoft External Staff Moderator

2025-07-02T06:10:48.5066667+00:00

Hi VinothKumarR

you can use

client.assistants.create with latest version of OpenAI instead of

client.beta.assistants.create

It is strange that chat completion calls get completed but client.beta.assistant.create did not pass.

Anway, it is best to update to latest version of OpenAI and use client.assistants.create instead.

Please let us know if it fixes your issues.

Thank you.
Manas Mohanty 6,285 Reputation points Microsoft External Staff Moderator

2025-07-04T06:08:05.4933333+00:00

Hi VinothKumarR

Please share the latest code and error trace on usage of client.beta.assistants to replicate and resolve the issue on our side.

Thank you.
Manas Mohanty 6,285 Reputation points Microsoft External Staff Moderator

2025-07-07T03:42:53.8566667+00:00

Hi VinothKumarR

We could not hear from you. Hope you appreciated our inputs.

Thank you.

Your answer

Anusree Nashetty 4,785 Reputation points Microsoft External Staff Moderator

2025-06-26T22:14:36.4133333+00:00

Hi VinothKumarR,

Ensure Azure Linux Agent (waagent) is up and running. Restart and verify the agent inside the VM: https://learn.microsoft.com/en-us/troubleshoot/azure/virtual-machines/linux/linux-azure-guest-agent

Ensure the correct endpoint (e.g., https://<resource-name>.openai.azure.com) and API key are used. https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#authentication

If using Private Endpoints, ensure DNS is correctly resolving to the private IP:

nslookup <your-resource-name>.openai.azure.com

A 500 error implies there might be an issue with the server-side or how the request is formed. If you're using any specific libraries or SDKs for making the requests, confirm they are up-to-date and compatible with Azure OpenAI.

If you have any further queries, let me know.
VinothKumarR 0 Reputation points

2025-06-27T10:56:41.5333333+00:00

following connection check code work in Azure VM

import os from openai import AzureOpenAI endpoint = "https://testdemo-oct13.openai.azure.com/" model_name = "gpt-4" deployment = "gpt-4" subscription_key = "****masked***" api_version = "2024-12-01-preview" client = AzureOpenAI( api_version=api_version, azure_endpoint=endpoint, api_key=subscription_key, ) response = client.chat.completions.create( messages=[ { "role": "system", "content": "You are a helpful assistant.", }, { "role": "user", "content": "I am going to Paris, what should I see?", } ], max_tokens=4096, temperature=1.0, top_p=1.0, model=deployment ) print(response.choices[0].message.content)

But the below actual script is not working... thought it works from calling from local PC

assistant = client.beta.assistants.create( name="TalentPro Vector Search Assistant", instructions=ASSISTANT_INSTRUCTIONS, model=assistant_deployment, tools=get_function_tools()
Manas Mohanty 6,285 Reputation points Microsoft External Staff Moderator

2025-07-02T06:10:48.5066667+00:00

Hi VinothKumarR

you can use

client.assistants.create with latest version of OpenAI instead of

client.beta.assistants.create

It is strange that chat completion calls get completed but client.beta.assistant.create did not pass.

Anway, it is best to update to latest version of OpenAI and use client.assistants.create instead.

Please let us know if it fixes your issues.

Thank you.
Manas Mohanty 6,285 Reputation points Microsoft External Staff Moderator

2025-07-04T06:08:05.4933333+00:00

Hi VinothKumarR

Please share the latest code and error trace on usage of client.beta.assistants to replicate and resolve the issue on our side.

Thank you.
Manas Mohanty 6,285 Reputation points Microsoft External Staff Moderator

2025-07-07T03:42:53.8566667+00:00

Hi VinothKumarR

We could not hear from you. Hope you appreciated our inputs.

Thank you.

Share via

Accessing Azure OpenAI from Azure VM (unix) is not working. However, i can access from AzureopenAI from local PC. have restriction to not update the network. Note both are same azure MSDN account. Getting Https 500 error. checked 443 port is working

Your answer