Prompt Flow “Chat with Wikipedia” Fails with OpenAI 404 NotFoundError — GPT-4o Deployed and Working in Playground

Question

Hi Team,

I’m currently using Azure AI Foundry and have deployed my OpenAI GPT-4o model, which is tested and working correctly in the OpenAI Playground.

However, when I try to use this model inside Prompt Flow (via “Chat with Wikipedia” template from Gallery or even when creating a custom flow from scratch), I receive the following error:

Error
OpenAI API hits NotFoundError: Error code: 404 - {'error': {'code': '404', 'message': 'Resource not found'}}

||

Additional context:

I am using the GPT-4o model from Azure OpenAI.

The service and deployment are correctly set up — tested via Playground and APIs.

The issue only appears when Prompt Flow tries to invoke the LLM.

I’ve also tried creating a flow from scratch — the issue persists.

I’ve attached a GIF showing the problem visually (not visible here).

What I’ve tried:

• Verified endpoint and deployment name.
• Tried with both prebuilt template ("Chat with Wikipedia") and custom flow.
• Checked resource names, permissions, and API keys.Additional context:
  • I am using the GPT-4o model from Azure OpenAI.
  • The service and deployment are correctly set up — tested via Playground and APIs.
  • The issue only appears when Prompt Flow tries to invoke the LLM.
  • I’ve also tried creating a flow from scratch — the issue persists.
• I’ve attached a GIF showing the problem visually (not visible here). What I’ve tried:
  • Verified endpoint and deployment name.
  • Tried with both prebuilt template ("Chat with Wikipedia") and custom flow.
  • Checked resource names, permissions, and API keys.