Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
This article explains how to change the model version and settings in the prompt builder. The model version and settings can affect the performance and behavior of the generative AI model.
Model version
You can change the model version by selecting Model at the top of the prompt builder. The dropdown menu allows you to select from the generative AI models that generate answers to your custom prompt.
The default model as of November 2024 is GPT-4o mini (general available, or GA). You can also use the more powerful GPT-4o model (GA), o1 model (paid public preview), or GPT 4.1 model (paid public preview). The exact minor versions of these models might change.
Using prompts in Power Apps or Power Automate consumes AI Builder credits, while using prompts in Copilot Studio consumes messages. Learn more in AI Builder licensing and credit management.
Models details
| GPT model | Status | Licensing rules | Functionalities | Region availabilities |
|---|---|---|---|---|
| GPT 4o Mini | GA - Default model | Consumes credits in Power Apps and Power Automate. More information: Power Platform Licensing Guide Consumes message in Microsoft Copilot Studio. More information: Message in Copilot Studio |
Trained on data up to October 2023. Context allowed up to 128k tokens. | Feature availability by regions for prompts |
| GPT 4o | GA | Consumes credits in Power Apps and Power Automate. More information: Power Platform Licensing Guide Consumes message in Copilot Studio. More information: Message in Copilot Studio |
Trained on data up to October 2023. Context allowed up to 128k tokens. | Feature availability by regions for prompts |
| o1 | Paid Public preview | Consumes credits in Power Apps and Power Automate. More information: Power Platform Licensing Guide. Consumes message in Copilot Studio. More information: Message in Copilot Studio |
Trained on data up to October 2023. Context allowed up to 200k tokens. | Feature availability by regions for prompts |
| GPT 4.1 | Paid Public preview | Consumes credits in Power Apps and Power Automate. Consumes message in Copilot Studio. GPT 4.1 model is a Standard model and consumes same rates as GPT 4o. |
Trained on data up to June 2024. Context allowed up to 1M tokens. | Feature availability by regions for prompts |
Choose between the model based on capabilities and scenarios.
Models comparison
| Factors | GPT-4o mini (default) | GPT-4o, GPT 4.1 | o1 |
|---|---|---|---|
| Cost | Lower, more cost-effective | Standard pricing | Premium pricing (paid preview) |
| Performance | Good for most tasks | Superior for complex tasks | Trained for reasoning tasks |
| Speed | Faster processing | Might be slower due to complexity | Slower as it reasons before responding |
| Use cases | Summarization, information tasks | Image and document processing, as well complex content creation tasks | Complex data analysis and reasoning tasks |
Decision narrative
When you need a cost-effective solution for moderately complex tasks, have limited computational resources, or require faster processing, choose GPT-4o Mini. It's ideal for projects with budget constraints and applications like customer support or efficient code analysis.
When you're dealing with highly complex, multimodal tasks that require superior performance and detailed analysis, choose GPT-4o or GPT 4.1. It's the better choice for large-scale projects where accuracy and advanced capabilities are crucial. Another scenario where it's a better choice is when you have the budget and computational resources to support it. GPT-4o is also preferable for long-term projects that might grow in complexity over time.
For projects requiring advanced reasoning capabilities, the o1 model excels. It's suitable for scenarios that demand sophisticated problem-solving and critical thinking. The o1 model excels in environments where nuanced reasoning, complex decision-making, and detailed analysis are important.
Model settings
You can access the setting panel by selecting ... > Settings at the top of the prompt builder. You can change the following settings:
- Temperature: Lower temperatures lead to predictable results, while higher temperatures allow more diverse or creative responses.
- Record retrieval: Number of records retrieved for your knowledge sources.
- Include links in the response: When selected, the response includes link citations for the retrieved records.
Temperature
The slider allows you to select the temperature of the generative AI model. It varies between 0 and 1, and guides the generative AI model about how much creativity (1) vs deterministic answer (0) it should provide.
Temperature is a parameter that controls the randomness of the output generated by the AI model. A lower temperature results in more predictable and conservative outputs. To compare, a higher temperature allows for more creativity and diversity in the responses. It’s a way to fine-tune the balance between randomness and determinism in the model’s output.
By default, the temperature is 0, as in previously created prompts.
| Temperature | Functionality | Use in |
|---|---|---|
| 0 | More predictable and conservative outputs. Responses are more consistent. |
Prompts that require high accuracy and less variability. |
| 1 | More creativity and diversity in the responses. More varied and sometimes more innovative responses. |
Prompts that create new out-of-the-box content |
Adjusting the temperature can influence the model’s output, but it doesn't guarantee a specific result. The AI’s responses are inherently probabilistic and can vary even with the same temperature setting.
Note
The temperature setting isn't available for the o1 model, so the slider is disabled when the o1 model is selected.
Upcoming model updates
- During the first week of July 2025, 4o mini model will be replaced by 4.1 mini model. At this date, existing prompts running on 4o mini will run on 4.1 mini, and the default model will be 4.1 mini.
- 4.1 mini rates in credits and messages are the same as 4o mini, so there won't be any change from licensing perspective.
- 4.1 mini release will come with higher maximum context window (1M tokens), and support of image and document input.
4.1 model will be in general availability (GA) in the second half of July 2025, and 4o model will be replaced by this 4.1 model in the same timeframe. This means existing prompts running on 4o will run on 4.1 after this update.