Edit

Share via

Bring your own model for your prompts (preview)

[This topic is prerelease documentation and is subject to change.]

The Azure AI Foundry models for prompts feature is available within Copilot Studio, Power Apps, and Power Automate. This native integration with Azure AI Foundry brings the latest frontier models into your prompts in Copilot Studio.

This includes the following models:

Important

You can access a diverse portfolio of AI models, including cutting-edge open-source solutions, industry-specific models, and task-based AI capabilities—all within the trusted, scalable, and enterprise-ready platform of Copilot Studio. With the native Azure AI Foundry integration, we bring the best capabilities from across our platforms into Copilot Studio to make it your one-stop hub to build agents.

Learn how to use your prompt in Copilot Studio, Power Apps, and Power Automate by selecting from the following links:

Create an agent

To use this feature, create an agent in Copilot Studio for your scenario.

  1. Sign in to Copilot Studio.

  2. In Copilot Studio, create an agent for your scenario by selecting Agents > New agent > Skip to configure.

  3. Fill in the fields, and then select Create.

    Learn about alternative instructions in Create an agent.

Add a prompt in an agent

You can add a prompt directly as an action to an agent, or add a prompt to a topic.

Add a tool in an agent

  1. In your agent, select the Tools tab > Add a tool.

  2. Select any of your existing prompts, or select New tool and select a prompt action.

    Screenshot of the 'Add tool' screen.

Add a prompt as a topic

Alternatively, you can create a prompt directly in the Topics tab in Copilot Studio and add it to the agent.

  1. In your agent, select the Topics tab.

  2. Select the plus sign (+) to add a node where you want to add a topic.

  3. Select Add a topic > New prompt.

    Screenshot of adding a tool in the 'Topics' tab.

Add and configure a prompt

After you create an agent, add prompt as an action to create a prompt.

  1. In Copilot Studio, select New tool > Prompt.

    The Tools tab contains the tools you can use in Copilot Studio. To use models from Azure AI Foundry, you can use the Prompt tool.

    Screenshot of the Copilot Studio tools.

  2. At the top of the screen, enter a name for your prompt.

  3. Enter your prompt in one of the following ways:

    • Use your own prompt: Under the Instructions heading, write or paste your own prompt.
    • Get help from Copilot: Under the Get started with Copilot heading, describe what you want your prompt to do, and then select the right arrow. Copilot suggests a prompt for you.

  4. While working with prompts, you can choose a model you want to work with. By default, you have some managed models available. You can also bring in Azure AI Foundry models and use them for your prompt.

    On the panel to the right of Instructions, select the dropdown menu in the Model field, and select the plus sign (+) to connect to a model from Azure AI Foundry.

    Screenshot of the 'New Prompt' screen, where you add a prompt and select a model.

  5. In the Connect a model from Azure AI Foundry screen, enter information about the model from Azure AI Foundry / Model catalog. Make sure to add the Model deployment name and Base model name exactly as they appear in Azure AI Foundry.

  6. Select Connect.

    Screenshot of the 'Connect a model from Azure AI Foundry' screen.

Use your model

Your model is now added to the Model dropdown menu. You can now select this model for your prompt and add it to the agent. Anytime this prompt runs, it always uses the selected model.

Screenshot of the 'Model' dropdown menu.

These models also work well with image and documents input. However, some models have a limitation. When image input is added, the dropdown menu shows only models from Azure AI Foundry that work with images. This allows you to select a model where you can be successful when you use images or documents.

Screenshot of the 'Models' dropdown menu with image and document models.

The following models work with images:

  • Phi-3.5-vision-instruct
  • Phi-4-multimodal-instruct
  • Phi-3-vision-128k-instruct
  • o1
  • GPT-4o
  • GPT-4o-mini
  • GPT-4
  • GPT-4.5-preview

Manage your Azure AI Foundry model

The Azure AI Foundry models are connected by connectors. You can set the governance policy for this connector in the policy page in the Power Platform admin center under the name 'Azure AI Foundry'. This allows you to add a specific DLP (data loss prevention) policy for these models and the tenant DLP policy.

Screenshot of the Power Platform admin center 'Data policies' page.

Each model where a maker set up a connection is also available as a connection page.

Screenshot of the 'Connections' page in Power Apps.

This currently supports models with chat completion type.

Limitation

Some models, for example Mistral, O3, LLana, and O4 mini aren't supported yet.

Note

We recommend you apply Responsible AI (RAI) policies as applicable for the models you want to use and manage that in Azure AI Foundry.

Learn more in Responsible AI for Azure AI Foundry.