After deplying Azure services successfully for chatbot , failing with deployment error when prompt request is made

Question

After deplying Azure services successfully for chatbot , failing with deployment error when prompt request is made

Gagan Sharma 40

openai.NotFoundError: Error code: 404 - {'error': {'code': 'DeploymentNotFound', 'message': 'The API deployment for this resource does not exist. If you created the deployment within the last 5 minutes, please wait a moment and try again.'}}

[2025-03-31 12:16:48 +0000] [17332] [INFO] 127.0.0.1:38752 POST /chat/stream 1.1 200 - 4850690

ERROR:root:Exception while generating response stream: Error code: 404 - {'error': {'code': 'DeploymentNotFound', 'message': 'The API deployment for this resource does not exist. If you created the deployment within the last 5 minutes, please wait a moment and try again.'}}

Traceback (most recent call last):

       ^^^^^^^^^^^^^^^^^

File "/workspaces/azure-search-openai-demo/.venv/lib/python3.11/site-packages/openai/_base_client.py", line 1856, in post

return await self.request(cast_to, opts, stream=stream, stream_cls=stream_cls)

       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/workspaces/azure-search-openai-demo/.venv/lib/python3.11/site-packages/openai/_base_client.py", line 1550, in request

return await self._request(

       ^^^^^^^^^^^^^^^^^^^^

File "/workspaces/azure-search-openai-demo/.venv/lib/python3.11/site-packages/openai/_base_client.py", line 1651, in _request

raise self._make_status_error_from_response(err.response) from None

santoshkc 15,615 Reputation points Microsoft External Staff Moderator

2025-03-31T13:55:26.0033333+00:00

Hi @Gagan Sharma,

If you just created the deployment, it might take a few minutes to be fully available. Please wait for a short while and try again. Additionally, check the logs for any errors that might provide more details.

If the issue persists, could you provide these details: Reference document, Region and Model name. This will help us investigate further.

Thank you.
Gagan Sharma 40 Reputation points

2025-03-31T15:31:51.24+00:00

Nothing new, I am stuck with it for last 4 days have checked all the services as far as i can and they are properly deployed and running ...
santoshkc 15,615 Reputation points Microsoft External Staff Moderator

2025-03-31T17:02:57.96+00:00
Hi @Gagan Sharma,

I understand your concern with this for several days. Since your deployment appears to be properly set up and running, let’s take a deeper look.

Could you confirm the following details?

Exact deployment name (as configured in Azure OpenAI)

Reference document (if any)

Region (to check if the right deployment is being called)

Logs or error messages

If possible, please provide the complete screenshot of the error page.

If everything looks correct, we might need to check quota limits or potential Azure service issues. Let me know, and we’ll troubleshoot further.
santoshkc 15,615 Reputation points Microsoft External Staff Moderator

2025-04-01T16:23:23.91+00:00

Hi @Gagan Sharma,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others.

Thank you.
Gagan Sharma 40 Reputation points

2025-04-01T16:40:16.8333333+00:00

check original message already attached complete error message

Region is east US2

here is the complete JSON

[ { "etag": ""9c96309d-e4f4-4739-aa64-8aaa1833653e"", "id": "/subscriptions/cf74fa9b-80a9-4822-81e5-0c73a81de5e9/resourceGroups/rg-Vitasta-Dev-RG/providers/Microsoft.CognitiveServices/accounts/cog-aijpk3m7cjl3i/deployments/chat", "name": "chat", "properties": { "callRateLimit": null, "capabilities": { "assistants": "true", "chatCompletion": "true", "maxContextToken": "16385", "maxOutputToken": "4096" }, "model": { "callRateLimit": null, "format": "OpenAI", "name": "gpt-35-turbo", "source": null, "version": "0125" }, "provisioningState": "Succeeded",

, "resourceGroup": "rg-Vitasta-Dev-RG", "sku": { "capacity": 1, "family": null, "name": "Standard", "size": null, "tier": null }, "systemData": { "createdAt": "2025-02-22T18:29:24.858500+00:00", "createdBy": "@outlook.com", "createdByType": "User", "lastModifiedAt": "2025-02-22T18:39:40.229320+00:00", "lastModifiedBy": "@outlook.com", "lastModifiedByType": "User" }, "type": "Microsoft.CognitiveServices/accounts/deployments" }, { "etag": ""3f19528a-2a26-45c0-8281-076ed2f4597f"", "id": "/subscriptions/cf74fa9b-80a9-4822-81e5-0c73a81de5e9/resourceGroups/rg-Vitasta-Dev-RG/providers/Microsoft.CognitiveServices/accounts/cog-aijpk3m7cjl3i/deployments/embedding", "name": "embedding", "properties": { "callRateLimit": null, "capabilities": { "embeddings": "true", "embeddingsMaxInputs": "2048" }, "model": { "callRateLimit": null, "format": "OpenAI", "name": "text-embedding-ada-002", "source": null, "version": "2" }, "provisioningState": "Succeeded", "raiPolicyName": null, "rateLimits": [ { "count": 1.0, "dynamicThrottlingEnabled": null, "key": "request", "matchPatterns": null, "minCount": null, "renewalPeriod": 10.0 }, { "count": 1000.0, "dynamicThrottlingEnabled": null, "key": "token", "matchPatterns": null, "minCount": null, "renewalPeriod": 60.0 } ], "scaleSettings": null, "versionUpgradeOption": "OnceNewDefaultVersionAvailable" },

santoshkc 15,615 Microsoft External Staff Moderator

Hi @Gagan Sharma,

It looks like your Azure OpenAI deployment is not being recognized. Please manually set the deployment parameters and then run azd up to apply the changes.

Run the following commands, replacing the placeholders with your existing Azure OpenAI service details:

 
Run azd env set AZURE_OPENAI_SERVICE {Name of existing OpenAI service}
Run azd env set AZURE_OPENAI_RESOURCE_GROUP {Name of existing resource group that OpenAI service is provisioned to}
Run azd env set AZURE_OPENAI_LOCATION {Location of existing OpenAI service}
Run azd env set AZURE_OPENAI_CHATGPT_DEPLOYMENT {Name of existing chat deployment}. Only needed if your chat deployment is not the default 'chat'.
Run azd env set AZURE_OPENAI_CHATGPT_MODEL {Model name of existing chat deployment}. Only needed if your chat model is not the default 'gpt-4o-turbo'.
Run azd env set AZURE_OPENAI_CHATGPT_DEPLOYMENT_VERSION {Version string for existing chat deployment}. Only needed if your chat deployment model version is not the default '0125'. You definitely need to change this if you changed the model.

Please refer for more info: Deploy existing resources.

Thank you.

Gagan Sharma 40 Reputation points

2025-04-02T19:04:27.6666667+00:00

It is already done Issue here is not that azure pipeline variable is not set, it is set that's why Chatbot started, and I was able to give prompt .

Issue here is after prompt is provided unable to find OpenAi deployment
JAYA SHANKAR G S 4,195 Reputation points Microsoft External Staff Moderator

2025-04-03T07:34:14.1033333+00:00

Hello @Gagan Sharma ,

Please add your chatbot configuration like environment variables and documentation or GitHub repository you are referring.

Thank you

Answer accepted by question author

0 additional answers

Your answer

santoshkc 15,615 Reputation points Microsoft External Staff Moderator

2025-03-31T13:55:26.0033333+00:00

Hi @Gagan Sharma,

If you just created the deployment, it might take a few minutes to be fully available. Please wait for a short while and try again. Additionally, check the logs for any errors that might provide more details.

If the issue persists, could you provide these details: Reference document, Region and Model name. This will help us investigate further.

Thank you.
Gagan Sharma 40 Reputation points

2025-03-31T15:31:51.24+00:00

Nothing new, I am stuck with it for last 4 days have checked all the services as far as i can and they are properly deployed and running ...
santoshkc 15,615 Reputation points Microsoft External Staff Moderator

2025-03-31T17:02:57.96+00:00

Hi @Gagan Sharma,

I understand your concern with this for several days. Since your deployment appears to be properly set up and running, let’s take a deeper look.

Could you confirm the following details?

Exact deployment name (as configured in Azure OpenAI)

Reference document (if any)

Region (to check if the right deployment is being called)

Logs or error messages

If possible, please provide the complete screenshot of the error page.

If everything looks correct, we might need to check quota limits or potential Azure service issues. Let me know, and we’ll troubleshoot further.
santoshkc 15,615 Reputation points Microsoft External Staff Moderator

2025-04-01T16:23:23.91+00:00

Hi @Gagan Sharma,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others.

Thank you.
santoshkc 15,615 Reputation points Microsoft External Staff Moderator

2025-04-02T16:56:35.89+00:00

Hi @Gagan Sharma,

It looks like your Azure OpenAI deployment is not being recognized. Please manually set the deployment parameters and then run azd up to apply the changes.

Run the following commands, replacing the placeholders with your existing Azure OpenAI service details:

Run azd env set AZURE_OPENAI_SERVICE {Name of existing OpenAI service} Run azd env set AZURE_OPENAI_RESOURCE_GROUP {Name of existing resource group that OpenAI service is provisioned to} Run azd env set AZURE_OPENAI_LOCATION {Location of existing OpenAI service} Run azd env set AZURE_OPENAI_CHATGPT_DEPLOYMENT {Name of existing chat deployment}. Only needed if your chat deployment is not the default 'chat'. Run azd env set AZURE_OPENAI_CHATGPT_MODEL {Model name of existing chat deployment}. Only needed if your chat model is not the default 'gpt-4o-turbo'. Run azd env set AZURE_OPENAI_CHATGPT_DEPLOYMENT_VERSION {Version string for existing chat deployment}. Only needed if your chat deployment model version is not the default '0125'. You definitely need to change this if you changed the model.

Please refer for more info: Deploy existing resources.

Thank you.
Gagan Sharma 40 Reputation points

2025-04-02T19:04:27.6666667+00:00

It is already done Issue here is not that azure pipeline variable is not set, it is set that's why Chatbot started, and I was able to give prompt .

Issue here is after prompt is provided unable to find OpenAi deployment
JAYA SHANKAR G S 4,195 Reputation points Microsoft External Staff Moderator

2025-04-03T07:34:14.1033333+00:00

Hello @Gagan Sharma ,

Please add your chatbot configuration like environment variables and documentation or GitHub repository you are referring.

Thank you

Answer 1

Hello @Gagan Sharma ,

As discussed, please find below the summary of the issue and the fix.

The chatbot was not functioning correctly due to missing environment variables leading to issues with deployment process.

In order to resolve this blocker, upon troubleshooting it was identified that the AZURE_OPENAI_EMB_DEPLOYMENT environment variable was not set correctly, which was causing the issue.

To fix this, first authenticate using azd auth login command and create a new environment using the azd env new .

Finally, execute azd up command to deploy the resources and create the necessary environment variables.

Ensure that you delete old resource groups and creating new ones to avoid any conflicts.

As you can see in the below screenshot the embeddings were created correctly and the chatbot was able to respond as expected both on local and on the container app.

Output:

Local - enter image description here

Containerized environment (container apps)

enter image description here

Hope this was helpful, it would be great if you accept the answer for betterment of community.

Thank you

JAYA SHANKAR G S 4,195 Reputation points Microsoft External Staff Moderator

2025-04-08T09:30:45.8566667+00:00

Hello @Gagan Sharma ,

I believe the above given answer helped you, please do accept it and give feedback by clicking on yes.

Thank you

Share via

After deplying Azure services successfully for chatbot , failing with deployment error when prompt request is made

0 additional answers

Your answer