Edit

AI-assisted testing for Windows apps

The winapp ui commands and winui-ui-testing skill let your AI agent inspect, interact with, and validate your app's UI automatically — describing what it sees in natural language so you can iterate without writing test harness code first.

UI inspection commands

The winui-ui-testing skill is included in the winui@awesome-copilot plugin. If you installed the plugin during setup, no additional install is required.

Command What it does
winapp ui inspect Dumps the accessibility tree of the running app
winapp ui screenshot Captures a screenshot of the app window
winapp ui click <selector> Clicks a button or selects an item
winapp ui invoke <selector> Invokes the default action on a control
winapp ui search <text> Searches the element tree by name or AutomationId
winapp ui set-value <selector> <value> Sets the value of a TextBox or ComboBox

Ask your agent to test the app

  1. Run the app: 
    dotnet run
  2. Ask your agent a natural-language question, such as:

    "Look at the running app and tell me if the Save button is reachable when the form is empty."

  3. The agent uses winapp ui inspect and winapp ui screenshot to examine the app and respond.

This workflow lets you catch issues — missing keyboard focus, disabled controls, layout problems — before writing a single line of test code.

Write automated tests

Once you've explored the app interactively, ask your agent to generate formal tests. Use this starter prompt:

Write an xUnit UI test for my WinUI 3 app that:
1. Launches the app with dotnet run
2. Verifies the main window title is "My App"
3. Clicks the button with AutomationId "SaveButton"
4. Verifies a success message appears
Use the winapp ui commands for element interaction.

The generated tests use winapp ui commands as the interaction layer, so they run without a separate UI automation framework.

Set AutomationIds in your XAML

For winapp ui click to target elements reliably, set AutomationProperties.AutomationId in your XAML:

<Button AutomationProperties.AutomationId="SaveButton"
        Content="Save" />
<TextBox AutomationProperties.AutomationId="TitleInput" />

Ask your agent: "Add AutomationId attributes to all interactive controls in this XAML."

Related content

  • Last updated on