Power Apps Test Engine overview (deprecated)

Note

Test Engine is deprecated and will be removed in a future release. Use Power Platform Playwright samples for test automation capabilities in Power Platform and Dynamics 365 services.

Power Apps Test Engine is a testing solution designed specifically for Power Platform applications. Whether you're new to automated testing, familiar with Test Studio, or an experienced developer with Playwright knowledge, Test Engine offers a scalable approach to testing that aligns with the low-code philosophy of Power Platform.

Learn more about how Test Engine helps you regardless of where you're starting from:

Manual Testers

If you're testing your Power Platform applications manually, Test Engine provides an accessible entry point to test automation:

• Low-code approach: Create automated tests using YAML and Power Fx, the same formula language used in Power Apps
• No DOM knowledge required: You don't need to understand HTML or CSS selectors to interact with your app's components
• Familiar terminology: Tests reference control names as they appear in Power Apps Studio, making tests easy to read and maintain

Test Engine can help you:

• Save time: Automate repetitive test scenarios that you're currently performing manually
• Increase coverage: Run more comprehensive tests more frequently
• Create a test baseline: Document your testing process in a format that can be reused and shared
• Learn gradually: Start with simple tests and expand as your comfort level increases

Test Studio users

If you're familiar with testing canvas apps using Test Studio, Test Engine represents an evolution in Power Platform testing:

• Command-line interface: Run tests from the Power Platform CLI, enabling integration with CI/CD pipelines
• Broader application support: Test Model-driven applications, Dataverse extensions, and canvas apps.
• Enhanced capabilities: Access features like connector mocking, screenshot capture, and video recording for comprehensive test coverage

Test Engine offers these advantages:

• Command-line execution: Run tests from terminals or CI/CD pipelines
• Broader application support: Test Model-driven apps and Dataverse integrations, not just Canvas apps
• Greater control: Customize test behavior with fine-grained settings
• Programmatic approach: Create test patterns that can be reused across multiple apps

Professional Developers

If you're a pro developer experienced with tools like Playwright, Test Engine offers:

• Domain-specific advantages: While Playwright operates at the DOM level, Test Engine applies the JavaScript object model of Power Apps for more resilient tests
• Efficiency gains: Create and maintain tests faster than traditional code-first approaches
• Integration options: Use the Preview.PlaywrightAction function when you need direct Playwright capabilities like locators

Test Engine provides:

• Power Platform optimization: Tests that understand the unique structure of Power Platform applications
• Lower maintenance: Tests that are more resilient to UI changes
• Team collaboration: A testing approach that both developers and low-code makers can understand
• Hybrid options: Use Playwright actions directly when needed for specialized scenarios

Currently, Power Apps Test Engine works with the following Power Platform components:

• Canvas Apps
• Model Driven Application
• Dataverse extensions

You must Install Microsoft Power Platform CLI to use the Test Engine.

Getting Started with Test Engine

The approach to getting started depends on your role and experience level:

Manual Testers

1. Install the Tools:

   • Install Microsoft Power Platform CLI
   • Familiarize yourself with basic command-line operations

2. Start with a Simple Test:

   • Begin with a basic test that validates a single screen or function
   • Use the YAML format to structure your test
   • Learn common Power Fx functions for testing

3. Build Your Testing Skills:

   • Follow tutorials and examples in the Test Engine documentation
   • Gradually add more complex scenarios to your tests

Test Studio users

1. Understand the Differences:

   • Test Engine uses a command-line approach instead of the interactive designer
   • Tests are written in YAML files with Power Fx expressions
   • Test Engine supports broader application types

2. Learn the Test Structure:

   • Review the YAML format to understand how tests are structured
   • See how authentication works differently in Test Engine

3. Expand Your Testing Scope:

   • Explore testing Model-driven applications
   • Learn about Dataverse integration for more comprehensive tests

Professional Developers

1. Evaluate the Architecture:

   • Review how Test Engine compares to Playwright
   • Understand the application types:
     • Canvas applications
     • Model-driven applications
     • Dataverse extensions

2. Integrate with Development Workflows:

   • Add Test Engine to your CI/CD pipelines
   • Explore the extensibility options for custom providers and functions

3. Use Advanced Features:

   • Implement connector mocking for isolated testing
   • Use Dataverse integration for end-to-end testing
   • Apply PlaywrightAction for specialized control interactions

Key features and benefits

Power Apps Test Engine provides a comprehensive set of features to support robust, low-code, and professional-grade testing for Power Platform solutions. The following highlights showcase how Test Engine can help you automate, validate, and maintain quality across your Power Platform applications.

End-to-end integration testing

Each of the following features are designed to help you achieve end-to-end integration testing across your Power Platform solutions:

• Comprehensive Power Platform Coverage: Test your entire solution with integrated testing for Canvas apps, Model-driven apps, and Dataverse
• Realistic User Journey Testing: Validate complete business processes across multiple Power Platform components, ensuring your solutions work as expected for real users
• Simplified Environment Setup: Use the same authentication context across your entire test suite, reducing setup complexity and maintenance overhead

Natural language and AI-powered testing

Each of the following features are designed to help you achieve Natural language and AI-powered integration testing across your Power Platform solutions:

• Copilot-Generated Tests: Create tests using natural language - describe what you want to test, and let Copilot help generate the test code
• Natural Language and Generative AI-Powered Testing: Create test plans in natural language and convert them to executable tests using Generative AI capabilities
• AI Result Validation: Confidently test AI-powered features with specialized functions that handle nondeterministic AI outputs
• Human-Readable Test Plans: Write and maintain tests that business users and developers can both understand and contribute to
• AI-Assisted Test Authoring: Use GitHub Copilot to accelerate test creation with source-controlled solutions

Power Fx test authoring

Using Power Fx as the text authoring language provides the following benefits:

• Familiar Formula Language: Write tests using the same Power Fx language you already know from building canvas apps
• Low Learning Curve: Use your existing Power Platform skills to create tests without learning complex testing frameworks
• Control Name References: Reference app controls by their studio names rather than having to learn complex DOM selectors

Enterprise-ready testing infrastructure

Enterprise customers require robust features to manage authentication securely. Test engine provides:

• Authentication Flexibility: Support for interactive login, service principal, and session persistence to fit your security requirements
• ALM Integration: Seamlessly integrate with Azure DevOps, GitHub Actions, and other CI/CD pipelines for automated testing
• MFA Support: Run automated tests in environments that enforce multifactor authentication without compromises

Advanced testing capabilities

These are advanced capabilities that Test engine provides:

• Connector Mocking: Create reliable tests by simulating connector responses, even for paid or external services
• Data Isolation: Test with predictable data conditions without impacting production environments
• Visual Diagnostics: Troubleshoot test failures with automatic screenshots and video recordings

Limitations

As Test Engine is in preview, be aware of these current limitations:

• Browser locale settings follow your default browser settings
• Some specialized controls can require using the Preview.PlaywrightAction function
• Performance testing capabilities are still in development

Supported browsers

The Test Engine works with the following browsers:

• Chromium (Chrome, Microsoft Edge)
• Firefox
• WebKit (Safari)

Next Steps

Explore Test Engine Features