IA-Connect UI
IA-Connect is a Robotic Process Automation RPA platform which adds RPA functionality from the Cloud to on-premises virtual machines or over Citrix or Microsoft Remote Desktop RDS connections. This is the module for Windows application User Interface Automation UIA.
This connector is available in the following products and regions:
Service | Class | Regions |
---|---|---|
Logic Apps | Standard | All Logic Apps regions except the following: - Azure Government regions - Azure China regions - US Department of Defense (DoD) |
Power Automate | Premium | All Power Automate regions except the following: - US Government (GCC) - US Government (GCC High) - China Cloud operated by 21Vianet - US Department of Defense (DoD) |
Power Apps | Premium | All Power Apps regions except the following: - US Government (GCC) - US Government (GCC High) - China Cloud operated by 21Vianet - US Department of Defense (DoD) |
Contact | |
---|---|
Name | Ultima Labs |
URL | https://www.ultima.com/ultima-labs |
IAConnect@ultima.com |
Connector Metadata | |
---|---|
Publisher | Ultima Labs |
Website | https://www.ultima.com/ultima-labs |
Privacy policy | https://www.ultima.com/privacy-policy |
Categories | IT Operations;Productivity |
IA-Connect is a Robotic Process Automation (RPA) platform which adds RPA functionality from Power Automate Cloud Flows to on-premises virtual machines or over Citrix or Microsoft Remote Desktop (RDS) connections. The IA-Connect Connectors provide over 650 actions, allowing you to automate every type of on-premise application directly from a Power Automate Cloud Flow. All IA-Connect actions are available directly from your Power Automate Cloud Flow providing easy integration between Cloud based and on-premises applications, the ability to leverage existing Power Automate conditions, loops, dynamic content, expressions and exception handling in your RPA processes. Utilising the IA-Connect Connectors also provides full execution history and auditability from the Flow run history whilst also removing the need to have a separate application/console/studio for developing your RPA processes.
Prerequisites
To use any of the IA-Connect Connectors, you must install the IA-Connect software. This is free to test for 30 days, following which you will require an IA-Connect license.
The IA-Connect software consists of two main components:
The IA-Connect Orchestrator, which is an Azure WebApp which you would host in your own Azure tenant. This handles the routing and security of RPA Flows to one or more on-premises or cloud-based virtual machines.
The IA-Connect Agent and Director, which is installed onto the virtual machines where the software you wish to automate is accessible. Additionally, the IA-Connect Agent can run inside a Citrix or Microsoft Remote Desktop Services (RDS) session, where the RPA commands are passed down a virtual channel into the remote session for execution. The IA-Connect Agent can be run from a network share and does not require installation.
Available IA-Connect Connectors
The available IA-Connect Connectors are:
- IA-Connect Dynamic Code
- IA-Connect Java
- IA-Connect Mainframe
- IA-Connect Microsoft Office
- IA-Connect SAP GUI
- IA-Connect Session
- IA-Connect UI
- IA-Connect Web Browser
How to get credentials
In order to receive your license and begin your 30-day free trial, please submit a request on our website (https://www.ultima.com/IA-Connect/Power-Automate).
Once a trial request is received, we will contact you via the email address provided to assist with setting up the IA-Connect software and to provide you with the trial license. This is a fully featured trial and will enable you to test any of the 650 actions across all 8 IA-Connect Connectors within your own environment during the trial period.
Get started with your connector
After submitting a trial request for IA-Connect, you will be able to download a ZIP file containing the IA-Connect software and documentation covering the installation and setup. We will also contact you to offer support and guidance through the installation process as required.
Support
During the trial period, you can contact Ultima Labs (IAConnect@ultima.com) for support and assistance.
Upon purchasing IA-Connect licenses you will receive support tokens which can be redeemed for bespoke training or support from Ultima's UK-based Technical Service Centre (TSC).
Known issues, common errors and FAQs
Our Knowledge Base contains a number of articles covering any known issues, common errors that may occur when using the IA-Connect Connectors and frequently asked questions. This is accessible at https://support.ultima.com/ultimalabs and an account to access these resources is provided during the IA-Connect trial and upon purchasing an IA-Connect license.
Creating a connection
The connector supports the following authentication types:
Default | Parameters for creating connection. | All regions | Not shareable |
Default
Applicable: All regions
Parameters for creating connection.
This is not shareable connection. If the power app is shared with another user, another user will be prompted to create new connection explicitly.
Name | Type | Description | Required |
---|---|---|---|
API Key | securestring | The API Key for this api | True |
IA-Connect Orchestrator address | string | Specify the IA-Connect Orchestrator address without the HTTP(S) component | True |
Throttling Limits
Name | Calls | Renewal Period |
---|---|---|
API calls per connection | 100 | 60 seconds |
Actions
Check multiple UIA elements |
Sets the state of multiple elements (typically a checkbox or radio box) to either checked or unchecked. |
Check UIA element |
Sets the state of an element (typically a checkbox or radio box) to either checked or unchecked. |
Click UIA list element item by index |
Clicks the list element that matches the specified index. This is typically used to select an item in a dropdown / menu item. |
Click UIA list element item by name |
Clicks the list element with the specified name. This is typically used to select an item in a dropdown / menu item. |
Close UIA element window |
Closes the element window. Typically only works on windows or dialogs. |
Collapse UIA element |
Collapses an element (typically a menu / dropdown item). If the item is already collapsed, nothing will happen. |
Does process have Win32 window |
A simple and fast Win32 action which reports whether a process (specified by name) has any visible windows. The window must exist: IA-Connect will not wait. It is recommended to use the action 'Wait for desktop element' which is more powerful. |
Does top level Win32 window exist |
A fast Win32 action which reports whether a top-level Win32 window exists. A top-level window is one which is connected to the desktop. You can search by class name or window title, or you can specify more advanced search filters, including wildcards. Although this action uses Win32 APIs, it can detect Windows, Java, ModernUI and Web windows. The window must exist, IA-Connect will not wait. It is more common to use the UIA action 'Does UIA desktop element exist' which is more powerful, but this Win32 action typically executes faster. |
Does UIA desktop element exist |
Reports whether a desktop element exists and provides some basic element properties. |
Does UIA element exist |
Reports whether an element exists and returns some basic element properties. |
Draw rectangle around UIA element |
Draws a rectangle around the perimeter of an element to aid in identifying that the element found is the one required. The rectangle is automatically removed after 5 seconds. |
Expand UIA element |
Expands an element (typically a menu / dropdown item). If the item is already expanded, nothing will happen. |
Focus UIA element |
Focusses an element which makes it the active element for keyboard focus and, depending on the application, may bring the element window to the foreground. |
Get multiple UIA element properties |
Returns the properties of multiple elements. This can be useful if you are uncertain which fields holds the property values required. |
Get multiple UIA elements as table |
Enumerates the values of child elements of a specified parent element and returns in a table format. This can be used to return rows and columns of data from elements which aren't technically tables, but have been arranged together into a table structure. This action can also be used to retrieve the results from a previous execution of this action, run as an Agent thread. |
Get multiple UIA parent element properties |
Returns a hierarchal tree of parent elements of the specified element, all the way up to the desktop (root level). The parent element is defined as the element which is at the next level up the UIA 'tree' and is almost always a containing element. |
Get UIA datagrid element contents |
Returns the contents of a datagrid element. This is an element with rows, columns, header and cells (i.e. a table). This action can also be used to retrieve the results from a previous execution of this action, run as an Agent thread. |
Get UIA datagrid element properties |
Returns table properties of a DataGrid element. This is an element with rows, columns, header and cells (i.e. a table). |
Get UIA desktop elements |
Returns a list of all windows and dialogs on the desktop. |
Get UIA element at screen coordinates |
Returns the UIA element located at the given screen coordinates. |
Get UIA element label value |
Returns the value of the label on the element. |
Get UIA element patterns |
Retrieve which UIA patterns are available for a UIA element, and hence which IA-Connect UIA actions are likely to have an effect on the element. |
Get UIA element properties |
Returns all properties of an element. This can be useful if you are uncertain which field holds the property values required. |
Get UIA element properties as list |
Returns the properties of an element as a single line list (single line collection / data table) instead of individual items, this maybe useful depending on how you intend to use the data. |
Get UIA element search colour region |
Returns the details of the region of pixels within a UIA element that meet the specified colour criteria. The element should be brought to the front first as the screenshot is taking a copy of the screen at the elements location. |
Get UIA element search mode |
Retrieves which UIA element search mode is being used by the IA-Connect Agent for UIA actions. |
Get UIA element text value |
Returns the text value of an element. A text value is usually associated with a label, but many elements can have this property. |
Get UIA element value |
Returns the value of an element. A value is usually associated with a text input area, but many elements can have this property. |
Get UIA handle for desktop |
Returns a handle for the desktop. This is an obsolete action because the handle '-2' can be used to refer to the desktop element but also because there are plenty of actions which can search relative to the desktop (e.g 'wait for desktop element'). |
Get UIA handle for focussed element |
Returns a handle for the currently focused UIA element. |
Get UIA handle for main window of focussed element |
Returns a handle for the main window of the currently focused UIA element. The 'Main' window is typically the main application window: a login dialog or sub-window is generally not the 'Main' window. |
Get UIA handle for process Id main window |
A simple and fast Win32 action which returns the handle for any main window of a process (specified by Process ID). The 'Main' window is typically the main application window: a login dialog or sub-window is generally not the 'Main' window. It is recommended to use the action 'Wait for desktop element' which is more powerful. |
Get UIA handle for process main window |
A simple and fast Win32 action which returns the handle for any main window of a process (specified by name). The 'Main' window is typically the main application window: a login dialog or sub-window is generally not the 'Main' window. The window must exist: IA-Connect will not wait. It is recommended to use the action 'Wait for desktop element' which is more powerful. |
Get UIA handle for top level Win32 window |
A fast Win32 action which returns a UIA handle for any top-level Win32 window which has the specified class name or window title, or you can specify more advanced search filters, including wildcards. A top-level window is one which is connected to the desktop. Although this action uses Win32 APIs, it can detect Windows, Java, ModernUI and Web windows. The window must exist, IA-Connect will not wait. It is more common to use the UIA action 'Does UIA desktop element exist' which is more powerful, but this Win32 action typically executes faster. |
Get UIA list element items |
Returns a list of child element items found under the specified element (typically dropdown / menu items). |
Get UIA parent element handle |
Returns a handle for the parent element of the specified element. The parent element is defined as the element which is at the next level up the UIA 'tree' and is almost always a containing element. |
Get Win32 windows |
A fast Win32 action which returns a list of all Win32 windows which optionally have the specified class name or window title, or you can specify more advanced search filters, including wildcards. Although this action uses Win32 APIs, it can detect Windows, Java, ModernUI and Web windows. Win32 Windows can include unexpected items including the taskbar, desktop, start menu, transparent overlays, offscreen or hidden windows, so the returned list may contain more results than expected. |
Global double left mouse click on UIA element |
Moves the mouse to the centre, or a chosen edge, corner or offset, relative to a UIA element and double clicks the left mouse button. |
Global input password into UIA element |
Moves the mouse to centre of the element, focusses it, left clicks, and presses keys. Typically used with a password input that will not accept native UIA input methods. |
Global input text into UIA element |
Moves the mouse to centre of the element, focusses it, left clicks, and presses keys. Typically used with a text input that will not accept native UIA input methods. |
Global left mouse click on UIA element |
Moves the mouse to the centre, or a chosen edge, corner or offset, relative to a UIA element and clicks the left mouse button. |
Global middle mouse click on UIA element |
Moves the mouse to the centre, or a chosen edge, corner or offset, relative to a UIA element and clicks the middle mouse button. |
Global mouse click UIA element search colour region |
Moves the mouse over a region of pixels within a UIA element that meet the specified colour criteria and performs a mouse click. The element should be brought to the front first as the screenshot is taking a copy of the screen at the elements location. |
Global right mouse click on UIA element |
Moves the mouse to the centre, or a chosen edge, corner or offset, relative to a UIA element and clicks the right mouse button. |
Input password into UIA element |
UIA action which inputs a password into an element (typically a password entry field), replacing the existing text. |
Input return into UIA element |
Inputs a Windows return / new line into an element (typically a text entry field), either replacing the existing text or inserting the return at a specific position. |
Input text into multiple UIA elements |
UIA Action which inputs different pieces of text into multiple elements (typically text entry fields), either replacing the existing text or inserting the new value at a specific position. |
Input text into UIA element |
UIA action which inputs text into an element (typically a text entry field), either replacing the existing text or inserting the new value at a specific position. |
Is UIA element checked |
This action returns true or false indicating whether an element (typically a checkbox or radio box) is checked. |
Maximise UIA window |
Maximises the window with the specified UIA handle. |
Minimise UIA window |
Minimises the window with the specified UIA handle. |
Move UIA element |
Moves a UIA element to a specified position on the screen. This action will typically only work with Window elements (which have the transform pattern). |
Press UIA element |
Presses an element (typically a button). |
Reset all UIA element handles |
Resets all UIA element handles currently stored by IA-Connect which can be useful if you have been identifying a lot of elements and have a large number of element handles stored. In scenarios with extremely high numbers of element handles (100,000+) this action can also be used to free up RAM usage. |
Resize UIA element |
Resizes a UIA element. This action will typically only work with Window elements (which have the transform pattern). |
Search for first UIA parent element |
Searches up the UIA tree hierarchy for the first parent element which matches the search criteria. The parent element is defined as the element which is at the next level up the UIA 'tree' and is almost always a containing element. |
Select UIA element |
Selects an element (typically an item in a list or drop-down). |
Set foreground UIA window |
Brings a window to the foreground. |
Set UIA element scroll percentage |
Set the horizontal and / or vertical scroll percentage of the specified element, if scrolling is supported by that element. If the element supports the 'scroll' pattern, you can apply this action directly to the element and specify either a horizontal or vertical scroll amount (or both). If the element doesn't support the 'scroll' pattern this action will fall back to the 'range value' or 'value' patterns, but you will need to apply these directly to the scroll bar control(s), not the element itself. |
Set UIA element search mode |
Choose which UIA element search mode should be used by the IA-Connect Agent when performing UIA actions. Typically, this action would only be used if you are having a problem with the default mode (Find all). |
Set UIA element to numeric range value |
Sets the value of the element which has a numeric range, for example a scrollbar. |
Set UIA element to numeric value |
Sets the value of the element which has a numeric input, for example a text field or a scrollbar. |
Set UIA transaction timeout |
Controls how long the UIA API will wait for an application to return the information about an element. This transaction timeout would typically only be reached if the application was non-responsive. |
Set UIA window to normal |
Normalises the window with the specified UIA handle (i.e. sets it to a normal sized window instead of minimised or maximised). |
Take screenshot of UIA element location |
Takes a screenshot of the location of an element and returns an image. The element should be brought to the front first as the screenshot is taking a copy of the screen at the elements location. |
Toggle UIA element |
Toggles an element (typically a checkbox or a radio box). This gives the element the opposite state to its current state (e.g. checked becomes unchecked and vice-versa). If you want to set a specific state, use the action 'Check element' instead. |
Wait for UIA desktop element |
Waits for a desktop element (typically a window) to exist. |
Wait for UIA desktop element to not exist |
Waits for a desktop element (typically a window) to no longer exist. |
Wait for UIA element |
Waits for an element (typically an individual element within a window such as a button or a text input area) to exist. |
Wait for UIA element to not exist |
Waits for an element (typically an individual element within a window such as a button or a text input area) to no longer exist. |
Wait for UIA process Id main window |
A simple and fast Win32 action which waits for a main window of a process (specified by Process ID) to exist and returns a handle. The 'Main' window is typically the main application window: a login dialog or sub-window is generally not the 'Main' window. It is recommended to use the action 'Wait for desktop element' which is more powerful. |
Wait for UIA process main window |
A simple and fast Win32 action which waits for a specified time for the main window of a process (specified by name) to exist before returning a handle. The 'Main' window is typically the main application window: a login dialog or sub-window is generally not the 'Main' window. It is recommended to use the action 'Wait for desktop element' which is more powerful. |
Wait for UIA top level Win32 window |
A fast Win32 action which waits for a specified time for a top-level Win32 window to exist before returning a UIA handle. A top-level window is one which is connected to the desktop. You can search by class name or window title, or you can specify more advanced search filters, including wildcards. Although this action uses Win32 APIs, it can detect Windows, Java, ModernUI and Web windows. It is more common to use the UIA action 'Wait for desktop element' which is more powerful, but this Win32 action typically executes faster. |
Check multiple UIA elements
Sets the state of multiple elements (typically a checkbox or radio box) to either checked or unchecked.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Input elements
|
InputElementsJSON | True | string |
An array of UIA elements to check, in JSON format. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Check UIA element
Sets the state of an element (typically a checkbox or radio box) to either checked or unchecked.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Check element
|
CheckElement | boolean |
Should the element be checked (true) or unchecked (false)? |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Click UIA list element item by index
Clicks the list element that matches the specified index. This is typically used to select an item in a dropdown / menu item.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Expand first
|
ExpandFirst | boolean |
If set to true then IA-Connect will attempt to expand the list before searching for the list item elements. This is useful for dynamic lists as the list item elements may not be created until the list is expanded. |
|
Collapse after
|
CollapseAfter | boolean |
If set to true then the list will be collapsed after executing the search. |
|
Item index
|
ItemIndex | integer |
The index in the list of the item to be clicked. |
|
Seconds between expand and collapse
|
SecondsBetweenExpandCollapse | double |
The number of seconds to wait between the expand and collapse actions if these are set to true. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Click UIA list element item by name
Clicks the list element with the specified name. This is typically used to select an item in a dropdown / menu item.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Expand first
|
ExpandFirst | boolean |
If set to true then IA-Connect will attempt to expand the list before searching for the list item elements. This is useful for dynamic lists as the list item elements may not be created until the list is expanded. |
|
Collapse after
|
CollapseAfter | boolean |
If set to true then the list will be collapsed after executing the search. |
|
Item name
|
ItemName | string |
The name of the element item to be clicked. |
|
Seconds between expand and collapse
|
SecondsBetweenExpandCollapse | double |
The number of seconds to wait between the expand and collapse actions if these are set to true. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Close UIA element window
Closes the element window. Typically only works on windows or dialogs.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Collapse UIA element
Collapses an element (typically a menu / dropdown item). If the item is already collapsed, nothing will happen.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Does process have Win32 window
A simple and fast Win32 action which reports whether a process (specified by name) has any visible windows. The window must exist: IA-Connect will not wait. It is recommended to use the action 'Wait for desktop element' which is more powerful.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Search process name
|
SearchProcessName | True | string |
The name of the process to search for, e.g. notepad. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Process has window
|
ProcessHasWindow | boolean |
Returns true if the process has a visible window, or false if not. |
Does top level Win32 window exist
A fast Win32 action which reports whether a top-level Win32 window exists. A top-level window is one which is connected to the desktop. You can search by class name or window title, or you can specify more advanced search filters, including wildcards. Although this action uses Win32 APIs, it can detect Windows, Java, ModernUI and Web windows. The window must exist, IA-Connect will not wait. It is more common to use the UIA action 'Does UIA desktop element exist' which is more powerful, but this Win32 action typically executes faster.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Search class name
|
SearchClassName | string |
The element class name of the top level window to search for, e.g. 'Notepad'. |
|
Search window title
|
SearchWindowTitle | string |
The title of the top level window to search for. |
|
Search process Id
|
SearchProcessId | integer |
The optional process Id of the process which owns the window (for example, as provided by the output of the 'Run Process' action in the IA-Connect Environment / Session actions). Set to 0 to not search by process Id. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators against available window properties. Example 1: [Width] < 200. Example 2: [Title] like '*Excel' AND [IsMinimised] = False AND [IsResizeable] = True. See the documentation for more examples. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Window exists
|
WindowExists | boolean |
Returns true if the window exists or false if not. |
Does UIA desktop element exist
Reports whether a desktop element exists and provides some basic element properties.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search process Id
|
SearchProcessId | integer |
If specified (a value of 1 or higher) then the search will only consider elements owned by a process with this Process ID (PID). If IA-Connect launched the process then the PID is provided by the 'Run Process' action in the IA-Connect Environment / Session actions. If you don't know the PID then leave this field blank (or 0). |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Return element handle
|
ReturnElementHandle | boolean |
If set to true, a handle to the located element will be returned. This handle can be used in further actions to act as a 'parent' handle. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Include child processes
|
IncludeChildProcesses | boolean |
If set to true and a 'Search process Id' is specified, child processes of that process Id are also included in the search. If set to false then only a process matching the exact 'Search process Id' will be returned. |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Element exists
|
ElementExists | boolean |
Returns true if the element exists or false if not. |
Element handle
|
ElementHandle | integer |
The UIA handle for the element. This can be used as an input to further UIA actions acting on this element. |
Element name
|
ElementName | string |
The UIA name of the element. |
Element class name
|
ElementClassName | string |
The UIA class name of the element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the element. |
Does UIA element exist
Reports whether an element exists and returns some basic element properties.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search process Id
|
SearchProcessId | integer |
If specified (a value of 1 or higher) then the search will only consider elements owned by a process with this Process ID (PID). If IA-Connect launched the process then the PID is provided by the 'Run Process' action in the IA-Connect Environment / Session actions. If you don't know the PID then leave this field blank (or 0). |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Return element handle
|
ReturnElementHandle | boolean |
If set to true, a handle to the located element will be returned. This handle can be used in further actions to act as a 'parent' handle. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Include child processes
|
IncludeChildProcesses | boolean |
If set to true and a 'Search process Id' is specified, child processes of that process Id are also included in the search. If set to false then only a process matching the exact 'Search process Id' will be searched. |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Element exists
|
ElementExists | boolean |
Returns true if the element exists or false if not. |
Element handle
|
ElementHandle | integer |
The UIA handle for the element. This can be used as an input to further UIA actions acting on this element. |
Element name
|
ElementName | string |
The UIA name of the element. |
Element class name
|
ElementClassName | string |
The UIA class name of the element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the element. |
Draw rectangle around UIA element
Draws a rectangle around the perimeter of an element to aid in identifying that the element found is the one required. The rectangle is automatically removed after 5 seconds.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Pen colour
|
PenColour | string |
The colour of the rectangle to be drawn (e.g. red, green, blue, yellow, purple or orange) or a string hex code e.g. #FF0000. |
|
Pen thickness pixels
|
PenThicknessPixels | integer |
The thickness (in pixels) of the highlight rectangle border. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Expand UIA element
Expands an element (typically a menu / dropdown item). If the item is already expanded, nothing will happen.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Focus UIA element
Focusses an element which makes it the active element for keyboard focus and, depending on the application, may bring the element window to the foreground.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Get multiple UIA element properties
Returns the properties of multiple elements. This can be useful if you are uncertain which fields holds the property values required.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element localized control type
|
SearchElementLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search descendants
|
SearchDescendants | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Return element handle
|
ReturnElementHandle | boolean |
If set to true, a handle to the located element will be returned. This handle can be used in further actions to act as a 'parent' handle. |
|
Return element value
|
ReturnElementValue | boolean |
If set to true than the value of the located element will be returned. |
|
First item to return
|
FirstItemToReturn | integer |
The element index of the first item to return, starting from 1. If you wish to return the elements in the reverse order (from the bottom of the UIA tree), you can alternatively specify a negative index starting from -1. |
|
Max items to return
|
MaxItemsToReturn | integer |
The maximum number of elements to return, or 0 to return all items. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Number of elements found
|
NumberOfElementsFound | integer |
The number of elements found that match the search criteria. |
Number of elements returned
|
NumberOfElementsReturned | integer |
The number of elements returned (this can be lower than the number of elements found if specifying a maximum number of items to return). |
Element properties
|
ElementProperties | array of object |
The element properties of the elements found that match the search criteria. |
items
|
ElementProperties | object |
Get multiple UIA elements as table
Enumerates the values of child elements of a specified parent element and returns in a table format. This can be used to return rows and columns of data from elements which aren't technically tables, but have been arranged together into a table structure. This action can also be used to retrieve the results from a previous execution of this action, run as an Agent thread.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
|
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Search cell header subelement localized control type
|
SearchCellHeaderSubElementLocalizedControlType | string |
The cell header subelement localized control type to search for. Leave blank if not searching for cell headers. |
|
Search cell header subelement control type
|
SearchCellHeaderSubElementControlType | integer |
The cell header subelement control type (an non-localized integer) to search for. This is the same value across different languages. Leave at 0 if not searching for cell headers. |
|
Search cell subelement localized control type
|
SearchCellSubElementLocalizedControlType | string |
The cell subelement localized control type to search for. |
|
Search cell subelement control type
|
SearchCellSubElementControlType | integer |
The cell subelement control type (an non-localized integer) to search for. This is the same value across different languages. |
|
Search descendants for cell subelements
|
SearchDescendantsForCellSubElements | boolean |
If set to true then the UIA tree below the located element will be searched for cell and cell header subelements (i.e. the element values which will populate the cells in the output table). This is more thorough but can take longer. You may wish to set this to false if you are only interested in elements directly beneath the element. |
|
First cell header subelement to return
|
FirstCellHeaderSubElementToReturn | integer |
The index of the first cell header subelement to return, starting from 1. If you wish to return the elements in the reverse order (from the bottom of the UIA tree), you can alternatively specify a negative index starting from -1. |
|
Max cell header subelements to return
|
MaxCellHeaderSubElementsToReturn | integer |
The maximum number of cell header subelements to return, or 0 to return all subelements. |
|
First cell subelement to return
|
FirstCellSubElementToReturn | integer |
The index of the first cell subelement to return, starting from 1. If you wish to return the elements in the reverse order (from the bottom of the UIA tree), you can alternatively specify a negative index starting from -1. |
|
Max cell subelements to return
|
MaxCellSubElementsToReturn | integer |
The maximum number of cell subelements to return, or 0 to return all subelements. |
|
Requested number of columns
|
RequestedNumberOfColumns | integer |
The number of columns you would like in the output table. This value must be correct for the element being read, or you will receive unexpected results. |
|
Cell subelement value priority
|
CellSubElementValuePriority | integer |
The priority for using the cell subelement value as the value to use in the output table. 1 is highest priority. 2 is second priority. 3 is third priority. 0 is do not use. |
|
Cell subelement text value priority
|
CellSubElementTextValuePriority | integer |
The priority for using the cell subelement text value as the value to use in the output table. 1 is highest priority. 2 is second priority. 3 is third priority. 0 is do not use. |
|
Cell subelement name value priority
|
CellSubElementNameValuePriority | integer |
The priority for using the cell subelement name (common for labels) as the value to use in the output table. 1 is highest priority. 2 is second priority. 3 is third priority. 0 is do not use. |
|
Minimum cell subelement width
|
MinimumCellSubElementWidth | integer |
The minimum width in pixels of a cell subelement to be included in the table. |
|
Minimum cell subelement height
|
MinimumCellSubElementHeight | integer |
The minimum height in pixels of a cell subelement to be included in the table. |
|
Search cell subelement bounding box left
|
SearchCellSubElementBoundingBoxLeft | integer |
Only include cell subelements which are fully contained within the bounding box. By default the bounding box is huge to include all elements. |
|
Search cell subelement bounding box right
|
SearchCellSubElementBoundingBoxRight | integer |
Only include cell subelements which are fully contained within the bounding box. By default the bounding box is huge to include all elements. |
|
Search cell subelement bounding box top
|
SearchCellSubElementBoundingBoxTop | integer |
Only include cell subelements which are fully contained within the bounding box. By default the bounding box is huge to include all elements. |
|
Search cell subelement bounding box bottom
|
SearchCellSubElementBoundingBoxBottom | integer |
Only include cell subelements which are fully contained within the bounding box. By default the bounding box is huge to include all elements. |
|
Read table as thread
|
ReadTableAsThread | boolean |
If set to false (the default), the IA-Connect Agent will read the table immediately and return the contents to the Director. If reading large tables, this action may time out. If set to true, the IA-Connect Agent will read the table as an Agent thread and the IA-Connect Director (or Orchestrator, PowerShell module, Blue Prism) can monitor the status of this Agent thread, waiting for it to complete. This allows large tables to be read without timeouts. IA-Connect Agents 9.3 and earlier could only read tables immediately, not as an Agent thread. |
|
Retrieve output data for thread Id
|
RetrieveOutputDataFromThreadId | integer |
If you previously ran this action as an Agent thread and set 'Seconds to wait for thread' to 0, provide the Agent thread Id to retrieve the results. This Agent thread Id will have been provided by the earlier call to this action. Set to 0 (the default) if you are reading a table (and hence not retrieving the results of a previous query run as an Agent thread). |
|
Seconds to wait for thread
|
SecondsToWaitForThread | integer |
If 'Read table as thread' is set to true, how many seconds to wait for the Agent thread to complete. If the Agent thread reading the table hasn't completed in this time, an exception will be raised. Set to 0 to bypass the wait: The Agent will continue to read the table, but also be available for the next action. You can then retrieve the results (the contents of the table) at a later time by using the action 'Wait for Agent thread to complete successfully' to wait for the Agent thread to complete and then re-run this 'Get multiple UIA elements as table' action with the input 'Retrieve output data for thread Id' set to the Agent thread Id. |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Number of cell subelements found
|
NumberOfCellSubElementsFound | integer |
The number of cell subelements (not headers) found that match the search criteria. |
Number of cell subelements returned
|
NumberOfCellSubElementsReturned | integer |
The number of cell subelements (not headers) returned (this can be lower than the number of elements found if specifying a first or maximum number of items to return). |
Table contents JSON
|
TableContentsJSON | string |
The table created from the multiple element contents, in JSON format. |
Number of rows in table
|
NumberOfRowsInTable | integer |
The number of rows in the output table. |
Number of columns in table
|
NumberOfColumnsInTable | integer |
The number of columns in the output table. |
Thread Id
|
ThreadId | integer |
If this action is being run as an Agent thread, this output will hold the Agent thread Id which can be used to monitor the action's process and retrieve the table contents when the thread has completed. |
Get multiple UIA parent element properties
Returns a hierarchal tree of parent elements of the specified element, all the way up to the desktop (root level). The parent element is defined as the element which is at the next level up the UIA 'tree' and is almost always a containing element.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Element handle
|
ElementHandle | True | integer |
The UIA handle for the target element. |
Max parents to process
|
MaxParentsToProcess | integer |
The maximum number of parent elements to process. By default, this is set to 50. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
UIA parent elements
|
UIAParentElements | array of object |
A list of all located parent elements (and their properties). The properties returned are the same as those returned by the 'Get multiple element properties' action. |
items
|
UIAParentElements | object | |
Number of parent elements returned
|
NumberOfParentElementsReturned | integer |
The number of parent elements returned from the search. |
Get UIA datagrid element contents
Returns the contents of a datagrid element. This is an element with rows, columns, header and cells (i.e. a table). This action can also be used to retrieve the results from a previous execution of this action, run as an Agent thread.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
|
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Retrieve Onscreen columns only
|
OnScreenColumnsOnly | boolean |
If set to true then only onscreen columns will be returned. |
|
Retrieve Onscreen rows only
|
OnScreenRowsOnly | boolean |
If set to true then only onscreen rows will be returned. |
|
Return null values as blank
|
ReturnNullValuesAsBlank | boolean |
If set to true, null values will be returned as '' (i.e. blank). If set to false, null values are typically returned as '(null)'. |
|
Alternative header row name
|
AlternativeHeaderRowName | string |
By default, the header row in a DataGrid has the UIA element name 'Top Row'. If the header row has a different name, specify that name here. |
|
Return row UIA name
|
ReturnRowUIAName | boolean |
If this input is set to then the row UIA name will be stored in a column in the output collection. The name of the column is defined by the input 'Name of column to store row UIA name'. |
|
Name of column to store row UIA name
|
NameOfColumnToStoreRowUIAName | string |
If the input 'Return row UIA name' is set to true then this input specifies the name of the column in the output collection to hold the row UIA name. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
First item to return
|
FirstItemToReturn | integer |
The element index of the first item (row) to return, starting from 1. |
|
Max items to return
|
MaxItemsToReturn | integer |
The maximum number of items (rows) to return, or 0 to return all items (rows). |
|
Scan first N rows for empty rows
|
ScanFirstNRowsForEmptyRows | integer |
Some datagrids have a few empty / null row elements in the UIA tree (usually at the top) and IA-Connect will automatically skip these row elements since they don't represent anything in the table which is visible in the UI. If this input is set to 0 (the default), the IA-Connect Agent will always scan row elements from the first row onwards, even if 'First item to return' is set to retrieve rows deeper within the table. This ensures consistency with row index numbers but impacts performance since all rows from the first row to the requested row(s) need to be scanned. If you are certain the only empty / null row elements in the table are within the first N (e.g. 10) rows, you can set this to N (e.g. 10) to potentially improve performance. Do not set to a value other than 0 unless you know what you are doing. |
|
Read table as thread
|
ReadTableAsThread | boolean |
If set to false (the default), the IA-Connect Agent will read the table immediately and return the contents to the Director. If reading large tables, this action may time out. If set to true, the IA-Connect Agent will read the table as an Agent thread and the IA-Connect Director (or Orchestrator, PowerShell module, Blue Prism) can monitor the status of this Agent thread, waiting for it to complete. This allows large tables to be read without timeouts. IA-Connect Agents 9.3 and earlier could only read tables immediately, not as an Agent thread. |
|
Retrieve output data for thread Id
|
RetrieveOutputDataFromThreadId | integer |
If you previously ran this action as an Agent thread and set 'Seconds to wait for thread' to 0, provide the Agent thread Id to retrieve the results. This Agent thread Id will have been provided by the earlier call to this action. Set to 0 (the default) if you are reading a datagrid (and hence not retrieving the results of a previous query run as an Agent thread). |
|
Seconds to wait for thread
|
SecondsToWaitForThread | integer |
If 'Read table as thread' is set to true, how many seconds to wait for the Agent thread to complete. If the Agent thread reading the table hasn't completed in this time, an exception will be raised. Set to 0 to bypass the wait: The Agent will continue to read the datagrid, but also be available for the next action. You can then retrieve the results (the contents of the datagrid) at a later time by using the action 'Wait for Agent thread to complete successfully' to wait for the Agent thread to complete and then re-run this 'Get UIA datagrid element contents' action with the input 'Retrieve output data for thread Id' set to the Agent thread Id. |
|
Scroll datagrid vertically every N percent
|
ScrollDataGridVerticallyEveryNPercent | integer |
The performance of reading some large datagrids (for example: with thousands of rows) has been observed to improve if you periodically scroll the datagrid into (or near) the location being scrolled. If set to 0 (the default), the datagrid will not be scrolled while reading the contents. If set to a value between 1 and 100, the datagrid will periodically be scrolled (every N percent of the total number of rows) while reading the contents. For example: If set to 20, the datagrid will be scrolled at 0, 20, 40, 60, 80 percent. Alternatively, use 'Scroll datagrid vertically every N rows' to scroll every N rows instead of every N percent. |
|
Scroll datagrid vertically every N rows
|
ScrollDataGridVerticallyEveryNRows | integer |
The performance of reading some large datagrids (for example: with thousands of rows) has been observed to improve if you periodically scroll the datagrid into (or near) the location being scrolled. If set to 0 (the default), the datagrid will not be scrolled while reading the contents. If set to a value 1 or higher, the datagrid will be scrolled every N rows while reading the contents. For example: If set to 5, the datagrid will be scrolled every 5 rows. Alternatively, use 'Scroll datagrid vertically every N percent' to scroll every N percent of the rows instead of every N rows. |
|
Scroll datagrid vertically element handle
|
ScrollDataGridVerticallyElementHandle | integer |
If scrolling the datagrid vertically while reading contents, this input defines how IA-Connect will locate the vertical scrollbar. If set to 0, IA-Connect will attempt to scroll the datagrid directly, either by using the 'scroll' pattern (if the datagrid supports it) or by searching for the vertical scrollbar contained within the datagrid. Alternatively, you can specify the IA-Connect UIA handle of the vertical scrollbar element (the scrollbar element itself, not the buttons within) which is a value of 1 or higher. |
|
Minimum datagrid rows for scrolling
|
MinimumDataGridRowsForScrolling | integer |
If scrolling the datagrid vertically while reading contents, this input specifies the minimum numbers of rows required in the table before IA-Connect will perform scrolling. If set to 0, IA-Connect will scroll regardless of the number of rows. If set to a positive number, IA-Connect will only perform scrolling when the datagrid has that number of rows or more. |
|
Raise exception if cannot scroll
|
RaiseExceptionIfCannotScroll | boolean |
If scrolling the datagrid vertically while reading contents: Set this input to true if a failure to scroll should be considered an exception, or set to false (the default) if a failure to scroll should be ignored. Common failures to scroll include failing to locate the scrollbars or the scrollbars don't have a UIA pattern suitable for scrolling ('scroll', 'rangevalue' or 'value'). |
|
Alternative vertical scrollbar name
|
AlternativeVerticalScrollbarName | string |
By default, the vertical scrollbar 'row' in a datagrid has the UIA element name 'Vertical Scroll Bar'. If the vertical scrollbar has a different name, specify that name here. This will be used if you want IA-Connect to periodically scroll the datagrid while reading the contents, the input 'Scroll datagrid vertically element handle' field is set to 0 (specifying that IA-Connect should scroll the datagrid directly) but the datagrid doesn't implement the 'scroll' pattern. |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Datagrid contents JSON
|
DataGridContentsJSON | string |
The datagrid element contents, in JSON format. |
Number of rows in table
|
NumberOfRowsInTable | integer |
The number of rows in the output table if the table was read immediately. |
Number of columns in table
|
NumberOfColumnsInTable | integer |
The number of columns in the output table if the table was read immediately. |
Thread Id
|
ThreadId | integer |
If this action is being run as an Agent thread, this output will hold the Agent thread Id which can be used to monitor the action's process and retrieve the datagrid contents when the thread has completed. |
Get UIA datagrid element properties
Returns table properties of a DataGrid element. This is an element with rows, columns, header and cells (i.e. a table).
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Alternative header row name
|
AlternativeHeaderRowName | string |
By default, the header row in a DataGrid has the UIA name 'Top Row'. If the header row has a different name, specify that name here. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Number of columns
|
NumberOfColumns | integer |
The number of columns in the datagrid. |
Number of visible columns
|
NumberOfVisibleColumns | integer |
The number of visible columns in the datagrid. |
Number of rows
|
NumberOfRows | integer |
The number of rows in the datagrid. |
Number of visible rows
|
NumberOfVisibleRows | integer |
The number of visible rows in the datagrid. |
First visible row
|
FirstVisibleRow | integer |
The index of the first visible row in the datagrid. |
Last visible row
|
LastVisibleRow | integer |
The index of the last visible row in the datagrid. |
Number of scrollbars
|
NumberOfScrollbars | integer |
The number of scrollbars that the datagrid has. |
Scrollbar names
|
ScrollbarNames | string |
A comma separated list of the names of the scrollbars (e.g. Horizontal, Vertical). |
Get UIA desktop elements
Returns a list of all windows and dialogs on the desktop.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Search element localized control type
|
SearchElementLocalizedControlType | string |
Filter the results by the localized control type of the element. |
|
Search process Id
|
SearchProcessID | integer |
If specified then the search will only consider elements owned by a process with this Process ID (PID). If IA-Connect launched the process then the PID is provided by the 'Run Process' action in the IA-Connect Environment / Session actions. If you don't know the PID then leave this field blank. |
|
Return element handle
|
ReturnElementHandle | boolean |
If set to true, a handle to the located element will be returned. This handle can be used in further actions to act as a 'parent' handle. |
|
First item to return
|
FirstItemToReturn | integer |
The element index of the first item to return, starting from 1. If you wish to return the elements in the reverse order (from the bottom of the UIA tree), you can alternatively specify a negative index starting from -1. |
|
Max items to return
|
MaxItemsToReturn | integer |
The maximum number of elements to return, or 0 to return all items. |
|
Include child processes
|
IncludeChildProcesses | boolean |
If set to true and a 'Search process Id' is specified, child processes of that process Id are also included in the search. If set to false then only a process matching the exact 'Search process Id' will be returned. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Number of elements found
|
NumberOfElementsFound | integer |
The number of desktop elements found that match the search criteria. |
Number of elements returned
|
NumberOfElementsReturned | integer |
The number of desktop elements returned (this can be lower than the number of elements found if specifying a maximum number of items to return). |
Element properties
|
ElementProperties | array of object |
The element properties of the desktop elements found that match the search criteria. |
items
|
ElementProperties | object |
Get UIA element at screen coordinates
Returns the UIA element located at the given screen coordinates.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
X coordinate
|
XCoord | integer |
The screen X coordinate value (in pixels) where the UIA element should be searched for. |
|
Y coordinate
|
YCoord | integer |
The screen Y coordinate value (in pixels) where the UIA element should be searched for. |
|
Raise exception if element not found
|
RaiseExceptionIfElementNotFound | boolean |
Should IA-Connect raise an exception if a UIA element was not located at the specified location? |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Element found
|
ElementFound | boolean |
Returns true if a UIA element was found at the specified location. |
Element handle
|
ElementHandle | integer |
The UIA handle for the element. This can be used as an input to further UIA actions acting on this element. |
Element name
|
ElementName | string |
The UIA name of the element. |
Element class name
|
ElementClassName | string |
The UIA class name of the element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the element. |
Get UIA element label value
Returns the value of the label on the element.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Element label value
|
ElementLabelValue | string |
The value of the label on the element. |
Get UIA element patterns
Retrieve which UIA patterns are available for a UIA element, and hence which IA-Connect UIA actions are likely to have an effect on the element.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Expand collapse pattern available
|
ExpandCollapsePatternAvailable | boolean |
The UIA expand collapse pattern is available and hence actions which expand or collapse an element (for example, a drop-down menu) are likely to work. |
Invoke pattern available
|
InvokePatternAvailable | boolean |
The UIA invoke pattern is available and hence actions which press an element or click a list element item are likely to work. |
Range value pattern available
|
RangeValuePatternAvailable | boolean |
The UIA range value pattern is available and hence actions which scroll an element or slider are likely to work. |
Scroll pattern available
|
ScrollPatternAvailable | boolean |
The UIA scroll pattern is available and hence actions which scroll an element are likely to work. |
Selection item pattern available
|
SelectionItemPatternAvailable | boolean |
The UIA selection item pattern is available and hence actions which select an element are likely to work. |
Text pattern available
|
TextPatternAvailable | boolean |
The UIA text pattern is available and hence actions which read an element text value are likely to work. |
Toggle pattern available
|
TogglePatternAvailable | boolean |
The UIA toggle pattern is available and hence actions which check, uncheck or toggle an element are likely to work. |
Value pattern available
|
ValuePatternAvailable | boolean |
The UIA value pattern is available and hence actions which input text into an element or read an element value are likely to work. Scrollbars may also react to a value pattern. |
Window pattern available
|
WindowPatternAvailable | boolean |
The UIA window pattern is available and hence actions which close, maximise or minimise an element are likely to work. |
Grid pattern available
|
GridPatternAvailable | boolean |
The UIA grid pattern is available. This pattern is not used by IA-Connect. |
Grid item pattern available
|
GridItemPatternAvailable | boolean |
The UIA grid item pattern is available. This pattern is not used by IA-Connect. |
Legacy IAccessible pattern available
|
LegacyIAccessiblePatternAvailable | boolean |
The UIA legacy IAccessible pattern is available. This pattern is not used by IA-Connect. |
Selection pattern available
|
SelectionPatternAvailable | boolean |
The UIA selection pattern is available. This pattern is not used by IA-Connect. |
Spreadsheet pattern available
|
SpreadsheetPatternAvailable | boolean |
The UIA spreadsheet pattern is available. This pattern is not used by IA-Connect. |
Spreadsheet item pattern available
|
SpreadsheetItemPatternAvailable | boolean |
The UIA spreadsheet item pattern is available. This pattern is not used by IA-Connect. |
Table pattern available
|
TablePatternAvailable | boolean |
The UIA table pattern is available. This pattern is not used by IA-Connect. |
Table item pattern available
|
TableItemPatternAvailable | boolean |
The UIA table item pattern is available. This pattern is not used by IA-Connect. |
Text pattern 2 available
|
TextPattern2Available | boolean |
The UIA text pattern 2 is available. This pattern is not used by IA-Connect. |
Text edit pattern available
|
TextEditPatternAvailable | boolean |
The UIA text edit pattern is available. This pattern is not used by IA-Connect. |
Transform pattern available
|
TransformPatternAvailable | boolean |
The UIA transform pattern is available. This pattern is not used by IA-Connect. |
Get UIA element properties
Returns all properties of an element. This can be useful if you are uncertain which field holds the property values required.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Return element handle
|
ReturnElementHandle | boolean |
If set to true, a handle to the located element will be returned. This handle can be used in further actions to act as a 'parent' handle. |
|
Return element value
|
ReturnElementValue | boolean |
If set to true than the value of the located element will be returned. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Validate clickable point within element boundary
|
ValidateClickablePointWithinElementBoundary | boolean |
For some elements, UIA is unaware of a clickable point within the element and will return an invalid coordinate (for example 0,0) instead of the center of the element. If this input is set to true, IA-Connect will check the validity of the coordinate provided by UIA and, if not within the element's boundary, will ignore the value provided by UIA and use the center of the element instead. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Element name
|
ElementName | string |
The UIA name of the element. |
Element class name
|
ElementClassName | string |
The UIA class name of the element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the element. |
Element framework Id
|
ElementFrameworkId | string |
The UIA framework Id of the element. |
Element control type
|
ElementControlType | string |
The UIA control type as a number. This is similar to localized control type but isn't language specific. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the element. |
Element is enabled
|
ElementIsEnabled | boolean |
Returns whether the element enabled or not. |
Element is offscreen
|
ElementIsOffscreen | boolean |
Returns whether the element is offscreen or not. |
Element is keyboard focusable
|
ElementIsKeyboardFocusable | boolean |
Returns whether the element can be focussed by the keyboard. |
Element has keyboard focus
|
ElementHasKeyboardFocus | boolean |
Returns whether the element currently has keyboard focus. |
Element is password field
|
ElementIsPasswordField | boolean |
Returns whether an element is a password input field. |
Element accelerator key
|
ElementAcceleratorKey | string |
Returns the hotkey which could be pressed to activate the element. |
Element access key
|
ElementAccessKey | string |
Returns the hotkey which could be pressed to activate a menu element. |
Element left edge
|
ElementLeftEdge | integer |
The distance in pixels between the left edge of the element or window and the left edge of the display. |
Element right edge
|
ElementRightEdge | integer |
The distance in pixels between the right edge of the element or window and the left edge of the display. |
Element top edge
|
ElementTopEdge | integer |
The distance in pixels between the top edge of the element or window and the top edge of the display. |
Element bottom edge
|
ElementBottomEdge | integer |
The distance in pixels between the bottom edge of the element or window and the top edge of the display. |
Element clickable point X
|
ElementClickablePointX | integer |
The X coordinate in pixels of a central clickable point in the element relative to the left edge of the display as returned by the underlying application. |
Element clickable point Y
|
ElementClickablePointY | integer |
The Y coordinate in pixels of a central clickable point in the element relative to the top edge of the display as returned by the underlying application. |
Element process ID
|
ElementProcessId | integer |
The Process ID (PID) of the process which owns this element. |
Element handle
|
ElementHandle | integer |
If the input 'Return element handle' was set to true, this will hold a numeric element handle which can be used in further actions to act as a 'parent' handle for further actions. |
Element value
|
ElementValue | string |
If the input 'Return element value' was set to true and if the element has a value pattern, this will hold that value. |
Element text value
|
ElementTextValue | string |
If the input 'Return element value' was set to true and if the element has a text value pattern, this will hold that text value. |
Get UIA element properties as list
Returns the properties of an element as a single line list (single line collection / data table) instead of individual items, this maybe useful depending on how you intend to use the data.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Element handle
|
ElementHandle | True | integer |
The UIA handle for the target element. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Number of elements found
|
NumberOfElementsFound | integer |
The number of elements found. |
Number of elements returned
|
NumberOfElementsReturned | integer |
The number of elements returned. |
UIA element properties JSON
|
UIAElementPropertiesJSON | string |
The UIA properties of the element, in JSON format. |
Get UIA element search colour region
Returns the details of the region of pixels within a UIA element that meet the specified colour criteria. The element should be brought to the front first as the screenshot is taking a copy of the screen at the elements location.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Search colour
|
SearchColour | True | string |
Search colour in the format 0xAARRGGBB, #AARRGGBB, 0xRRGGBB or #RRGGBB where each colour channel is a byte in hex format (00 is fully off, FF is fully on). For example: #FF0000 for red, #00FF00 for blue, #000000 for black, #FFFFFF for white. |
Max colour deviation
|
MaxColourDeviation | True | integer |
The maximum an element colour can deviate from the search colour before it isn't considered a match. 0 for no deviation. Deviation is measured in RGB values. For example: #FF0000 is 4 different from #FE0102. A deviation of 15 would be a good starting point. |
Left pixel X offset
|
LeftPixelXOffset | integer |
An optional X offset for the left edge of the search area. This allows you to increase (with negative values) or decrease (with positive values) the search area. |
|
Right pixel X offset
|
RightPixelXOffset | integer |
An optional X offset for the right edge of the search area. This allows you to increase (with positive values) or decrease (with negative values) the search area. |
|
Top pixel Y offset
|
TopPixelYOffset | integer |
An optional Y offset for the top edge of the search area. This allows you to increase (with negative values) or decrease (with positive values) the search area. |
|
Bottom pixel Y offset
|
BottomPixelYOffset | integer |
An optional Y offset for the bottom edge of the search area. This allows you to increase (with positive values) or decrease (with negative values) the search area. |
|
Hide Agent
|
HideAgent | boolean |
Set to true to automatically hide the Agent (if visible) to ensure it doesn't obscure the element being analysed. |
|
Return screen coordinates as physical
|
ReturnPhysicalCoordinates | boolean |
Set to true for the screen coordinates to be returned as physical coordinates. Set to false for the screen coordinates to be returned as virtual coordinates. If the underlying display scaling is 100%, both physical and virtual coordinates are the same. Element coordinates are always returned as virtual coordinates. |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Number of pixels matching colour
|
NumberOfPixelsMatchingColour | integer |
The number of pixels which match the specified colour. |
Colour match bounding box element left pixel
|
ColourMatchBoundingBoxElementLeftPixelXCoord | integer |
The virtual X-coordinate of the left-most pixel matching the specified colour, relative to the element virtual top-left. |
Colour match bounding box element right pixel
|
ColourMatchBoundingBoxElementRightPixelXCoord | integer |
The virtual X-coordinate of the right-most pixel matching the specified colour, relative to the element virtual top-left. |
Colour match bounding box element top pixel
|
ColourMatchBoundingBoxElementTopPixelYCoord | integer |
The virtual Y-coordinate of the top-most pixel matching the specified colour, relative to the element virtual top-left. |
Colour match bounding box element bottom pixel
|
ColourMatchBoundingBoxElementBottomPixelYCoord | integer |
The virtual Y-coordinate of the bottom-most pixel matching the specified colour, relative to the element virtual top-left. |
Colour match bounding box element center X pixel
|
ColourMatchBoundingBoxElementCenterPixelXCoord | integer |
The virtual X-coordinate of the center of the bounding box containing pixels matching the specified colour, relative to the element virtual top-left. |
Colour match bounding box element center Y pixel
|
ColourMatchBoundingBoxElementCenterPixelYCoord | integer |
The virtual Y-coordinate of the center of the bounding box containing pixels matching the specified colour, relative to the element virtual top-left. |
Colour match bounding box screen left pixel
|
ColourMatchBoundingBoxScreenLeftPixelXCoord | integer |
The screen pixel X-coordinate of the left-most pixel matching the specified colour. This is either a physical or virtual coordinate depending on the input 'Return physical coordinates'. |
Colour match bounding box screen right pixel
|
ColourMatchBoundingBoxScreenRightPixelXCoord | integer |
The screen pixel X-coordinate of the right-most pixel matching the specified colour. This is either a physical or virtual coordinate depending on the input 'Return physical coordinates'. |
Colour match bounding box screen top pixel
|
ColourMatchBoundingBoxScreenTopPixelYCoord | integer |
The screen pixel Y-coordinate of the top-most pixel matching the specified colour. This is either a physical or virtual coordinate depending on the input 'Return physical coordinates'. |
Colour match bounding box screen bottom pixel
|
ColourMatchBoundingBoxScreenBottomPixelYCoord | integer |
The screen pixel Y-coordinate of the bottom-most pixel matching the specified colour. This is either a physical or virtual coordinate depending on the input 'Return physical coordinates'. |
Colour match bounding box screen center X pixel
|
ColourMatchBoundingBoxScreenCenterPixelXCoord | integer |
The screen pixel X-coordinate of the center of the bounding box containing pixels matching the specified colour. This is either a physical or virtual coordinate depending on the input 'Return physical coordinates'. |
Colour match bounding box screen center Y pixel
|
ColourMatchBoundingBoxScreenCenterPixelYCoord | integer |
The screen pixel Y-coordinate of the center of the bounding box containing pixels matching the specified colour. This is either a physical or virtual coordinate depending on the input 'Return physical coordinates'. |
Get UIA element search mode
Retrieves which UIA element search mode is being used by the IA-Connect Agent for UIA actions.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
UIA element search mode
|
UIAElementSearchMode | string |
The UIA element search mode current used by the IA-Connect Agent. |
Get UIA element text value
Returns the text value of an element. A text value is usually associated with a label, but many elements can have this property.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Element text value
|
ElementTextValue | string |
The text value of the element. |
Get UIA element value
Returns the value of an element. A value is usually associated with a text input area, but many elements can have this property.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Element value
|
ElementValue | string |
The value of the element. |
Get UIA handle for desktop
Returns a handle for the desktop. This is an obsolete action because the handle '-2' can be used to refer to the desktop element but also because there are plenty of actions which can search relative to the desktop (e.g 'wait for desktop element').
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Window handle
|
WindowHandle | integer |
The UIA handle for the desktop. This can be used as an input to further UIA actions within this window. |
Element name
|
ElementName | string |
The UIA name of the desktop element. |
Element class name
|
ElementClassName | string |
The UIA class name of the desktop element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the desktop element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the desktop element. |
Get UIA handle for focussed element
Returns a handle for the currently focused UIA element.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Window handle
|
WindowHandle | integer |
The UIA handle for the window. This can be used as an input to further UIA actions within this window. |
Element name
|
ElementName | string |
The UIA name of the element. |
Element class name
|
ElementClassName | string |
The UIA class name of the element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the element. |
Get UIA handle for main window of focussed element
Returns a handle for the main window of the currently focused UIA element. The 'Main' window is typically the main application window: a login dialog or sub-window is generally not the 'Main' window.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Window handle
|
WindowHandle | integer |
The UIA handle for the window. This can be used as an input to further UIA actions within this window. |
Element name
|
ElementName | string |
The UIA name of the window element. |
Element class name
|
ElementClassName | string |
The UIA class name of the window element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the window element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the window element. |
Get UIA handle for process Id main window
A simple and fast Win32 action which returns the handle for any main window of a process (specified by Process ID). The 'Main' window is typically the main application window: a login dialog or sub-window is generally not the 'Main' window. It is recommended to use the action 'Wait for desktop element' which is more powerful.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Search process Id
|
ProcessId | True | integer |
The Id of the process to wait for (as provided by the 'Run Process' action in the IA-Connect Environment / Session actions). |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Window handle
|
WindowHandle | integer |
The UIA handle for the window. This can be used as an input to further UIA actions within this window. |
Element name
|
ElementName | string |
The UIA name of the window element. |
Element class name
|
ElementClassName | string |
The UIA class name of the window element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the window element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the window element. |
Get UIA handle for process main window
A simple and fast Win32 action which returns the handle for any main window of a process (specified by name). The 'Main' window is typically the main application window: a login dialog or sub-window is generally not the 'Main' window. The window must exist: IA-Connect will not wait. It is recommended to use the action 'Wait for desktop element' which is more powerful.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Search process name
|
SearchProcessName | True | string |
The name of the process to search for, e.g. notepad. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Window handle
|
WindowHandle | integer |
The UIA handle for the window. This can be used as an input to further UIA actions within this window. |
Element name
|
ElementName | string |
The UIA name of the window element. |
Element class name
|
ElementClassName | string |
The UIA class name of the window element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the window element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the window element. |
Get UIA handle for top level Win32 window
A fast Win32 action which returns a UIA handle for any top-level Win32 window which has the specified class name or window title, or you can specify more advanced search filters, including wildcards. A top-level window is one which is connected to the desktop. Although this action uses Win32 APIs, it can detect Windows, Java, ModernUI and Web windows. The window must exist, IA-Connect will not wait. It is more common to use the UIA action 'Does UIA desktop element exist' which is more powerful, but this Win32 action typically executes faster.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Search class name
|
SearchClassName | string |
The element class name of the top level window to search for, e.g. 'Notepad'. |
|
Search window title
|
SearchWindowTitle | string |
The title of the top level window to search for. |
|
Search process Id
|
SearchProcessId | integer |
The optional process Id of the process which owns the window (for example, as provided by the output of the 'Run Process' action in the IA-Connect Environment / Session actions). Set to 0 to not search by process Id. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators against available window properties. Example 1: [Width] < 200. Example 2: [Title] like '*Excel' AND [IsMinimised] = False AND [IsResizeable] = True. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple windows match the search, this allows you to specify which window property to sort by. This will be used in conjunction with 'Match index' to pick the required window. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching window nearest the top of the screen will be returned. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple windows match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Window handle
|
WindowHandle | integer |
The UIA handle for the window. This can be used as an input to further UIA actions within this window. |
Element name
|
ElementName | string |
The UIA name of the window element. |
Element class name
|
ElementClassName | string |
The UIA class name of the window element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the window element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the window element. |
Get UIA list element items
Returns a list of child element items found under the specified element (typically dropdown / menu items).
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Expand first
|
ExpandFirst | boolean |
If set to true then IA-Connect will attempt to expand the list before searching for the list item elements. This is useful for dynamic lists as the list item elements may not be created until the list is expanded. |
|
Collapse after
|
CollapseAfter | boolean |
If set to true then the list will be collapsed after executing the search. |
|
Check for selected items
|
CheckForSelectedItems | boolean |
If set to true then the output collection will contain an additional property indicating whether the list item is currently selected. |
|
Seconds between expand and collapse
|
SecondsBetweenExpandCollapse | double |
The number of seconds to wait between the expand and collapse actions if these are set to true. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Number of list items
|
NumberOfListItems | integer |
The number of items in the list. |
List items JSON
|
ListItemsJSON | string |
The properties of the items in the list, in JSON format. |
Number of selected items
|
NumberOfSelectedItems | integer |
The number of selected items in the list. |
Index of first selected item
|
IndexOfFirstSelectedItem | integer |
The index in the list of the first selected item. |
Selected item name
|
SelectedItemName | string |
The name of the selected item. |
Get UIA parent element handle
Returns a handle for the parent element of the specified element. The parent element is defined as the element which is at the next level up the UIA 'tree' and is almost always a containing element.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Element handle
|
ElementHandle | True | integer |
The UIA handle for the target element. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Parent element handle
|
ParentElementHandle | integer |
A UIA handle for the parent element. |
Get Win32 windows
A fast Win32 action which returns a list of all Win32 windows which optionally have the specified class name or window title, or you can specify more advanced search filters, including wildcards. Although this action uses Win32 APIs, it can detect Windows, Java, ModernUI and Web windows. Win32 Windows can include unexpected items including the taskbar, desktop, start menu, transparent overlays, offscreen or hidden windows, so the returned list may contain more results than expected.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Search class name
|
SearchClassName | string |
The optional class name of the top level window to search for, e.g. 'Chrome_WidgetWin_1'. |
|
Search window title
|
SearchWindowTitle | string |
The optional title of the top level window to search for. |
|
Only retrieve top level windows
|
TopLevelWindowsOnly | boolean |
Set to true to only retrieve Win32 windows which the OS considers to be top-level. Set to false to retrieve all Win32 windows. Note that the Win32 definition of a window will include items you might not recognise as a window and many dialogs and message boxes are marked as top-level even though they are a child of a parent window. |
|
Only retrieve visible windows
|
VisibleWindowsOnly | boolean |
Set to true to only retrieve Win32 windows which the OS considers to be visible. Set to false to retrieve both visible and non-visible Win32 windows. Note that offscreen or transparent windows might be marked as visible, but you cannot see them. |
|
Only retrieve windows with a title bar
|
WindowsWithTitlebarOnly | boolean |
Set to true to only retrieve Win32 windows with a title bar. Set to false to retrieve Win32 windows regardless of whether they have a title bar or not. Note that some transparent windows have title bars but you cannot see them. |
|
Only retrieve windows with a title
|
WindowsWithTitleOnly | boolean |
Set to true to only retrieve Win32 windows with a title (i.e. a title bar containing some text). Set to false to retrieve Win32 windows regardless of whether they have a title. Note that the title bar is the strip across the top of the window whereas the title is the text within it. |
|
Ignore transparent windows
|
IgnoreTransparentWindows | boolean |
Set to true to only retrieve Win32 windows which do not have transparency. Set to false to retrieve Win32 windows regardless of whether they have transparency set or not. |
|
Search process Id
|
SearchProcessId | integer |
The optional process Id of the process which owns the windows (for example, as provided by the output of the 'Run Process' action in the IA-Connect Environment / Session actions). Set to 0 to not search by process Id. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Title] like '*Excel' AND [IsMinimised] = False AND [IsResizeable] = True. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple windows match the search, this allows you to specify which window property to sort by. For example: If 'Sort by column name' is [TopEdge] then the list of windows will be returned ordered by top edge. If this field is left blank, windows will be returned in the order they are detected. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple windows match the search and a sort column is specified, set to true (default) to sort ascending or set to false to sort descending. |
|
Return UIA element handle
|
ReturnElementHandle | boolean |
If set to true, a UIA handle to each located Win32 window will be returned in the output collection (in the column 'UIAHandle'). This handle can be used in further actions to act as a 'parent' handle in IA-Connect UIA actions. |
|
First item to return
|
FirstItemToReturn | integer |
The index of the first window (row) to return, starting from 1. |
|
Max items to return
|
MaxItemsToReturn | integer |
The maximum number of windows to return, or 0 to return all items. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Win32 windows JSON
|
Win32WindowsJSON | string |
A list of Win32 windows matching the search criteria, in JSON format. |
Number of Win32 windows
|
NumberOfWin32Windows | integer |
The number of Win32 windows returned. |
Global double left mouse click on UIA element
Moves the mouse to the centre, or a chosen edge, corner or offset, relative to a UIA element and double clicks the left mouse button.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Delay in milliseconds
|
DelayInMilliseconds | integer |
The delay (in milliseconds) between each of the clicks. |
|
Focus element first
|
FocusElementFirst | boolean |
Should IA-Connect attempt to focus the element before global clicking? |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Click offset X
|
ClickOffsetX | integer |
The number of X pixels to offset the click action by. This parameter supports both positive (right) and negative (left) offset values. |
|
Click offset Y
|
ClickOffsetY | integer |
The number of Y pixels to offset the click action by. This parameter supports both positive (down) and negative (up) offset values. |
|
Offset relative to
|
OffsetRelativeTo | string |
The relative position of the element to offset from (Center / Centre / Middle, Left, Right, Top, Bottom, Top Left, Top Right, Bottom Left, Bottom Right). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Validate clickable point within element boundary
|
ValidateClickablePointWithinElementBoundary | boolean |
For some elements, UIA is unaware of a clickable point within the element and will return an invalid coordinate (for example 0,0) instead of the center of the element. If this input is set to true, IA-Connect will check the validity of the coordinate provided by UIA and, if not within the element's boundary, will ignore the value provided by UIA and use the center of the element instead. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Global input password into UIA element
Moves the mouse to centre of the element, focusses it, left clicks, and presses keys. Typically used with a password input that will not accept native UIA input methods.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Focus element first
|
FocusElement | boolean |
Should IA-Connect attempt to focus the element before global clicking? |
|
Global left mouse click on element
|
GlobalMouseClickOnElement | boolean |
Should a global mouse click be performed at the element coordinates (to focus the element) before entering text? |
|
Replace existing value using double mouse click delete
|
ReplaceExistingValueUsingDoubleClickDelete | boolean |
Should any existing value be replaced by double clicking the mouse (to highlight it) and then deleting? |
|
Replace existing value using CTRL-A delete
|
ReplaceExistingValueUsingCTRLADelete | boolean |
Should any existing value be replaced by pressing Ctrl-A (to highlight all) and then deleting? Some elements may not support highlighting with Ctrl-A in which case the alternative option of 'Replace existing value using double mouse click delete' should be tried. |
|
Password to input
|
PasswordToInput | True | password |
The password value to global input using the keyboard. |
Use send key events
|
SendKeyEvents | boolean |
If set to true then send key events (a lower level API which sends simulated keystrokes to the operating system) will be used. If set to false then send keys (a higher level API which sends keystrokes to the focused element) will be used instead. |
|
Interval in milliseconds
|
Interval | integer |
The number of milliseconds between each key press. |
|
Dont interpret symbols
|
DontInterpretSymbols | boolean |
Should symbols in the 'Password to input' not be interpreted as special keys (e.g. + for Shift, ^ for Ctrl)? This should be set to true if you are attempting to input the actual symbols. |
|
Password contains stored password
|
PasswordContainsStoredPassword | boolean |
Set to true if the password contains (or is entirely) an IA-Connect stored password identifier, in the format {IAConnectPassword:StoredPasswordIdentifier} or an IA-Connect Orchestrator generic credential, in the format {OrchestratorCredential:FriendlyName}. This stored password could have been generated by the 'Generate password' action, for example, or be held by the IA-Connect Orchestrator. |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Validate clickable point within element boundary
|
ValidateClickablePointWithinElementBoundary | boolean |
For some elements, UIA is unaware of a clickable point within the element and will return an invalid coordinate (for example 0,0) instead of the center of the element. If this input is set to true, IA-Connect will check the validity of the coordinate provided by UIA and, if not within the element's boundary, will ignore the value provided by UIA and use the center of the element instead. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Global input text into UIA element
Moves the mouse to centre of the element, focusses it, left clicks, and presses keys. Typically used with a text input that will not accept native UIA input methods.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Focus element first
|
FocusElement | boolean |
Should IA-Connect attempt to focus the element before global clicking? |
|
Global left mouse click on element
|
GlobalMouseClickOnElement | boolean |
Should a global mouse click be performed at the element coordinates (to focus the element) before entering text? |
|
Replace existing value using double mouse click delete
|
ReplaceExistingValueUsingDoubleClickDelete | boolean |
Should any existing value be replaced by double clicking the mouse (to highlight it) and then deleting? |
|
Replace existing value using CTRL-A delete
|
ReplaceExistingValueUsingCTRLADelete | boolean |
Should any existing value be replaced by pressing Ctrl-A (to highlight all) and then deleting? Some elements may not support highlighting with Ctrl-A in which case the alternative option of 'Replace existing value using double mouse click delete' should be tried. |
|
Text to input
|
TextToInput | string |
The text value to global input using the keyboard. |
|
Use send key events
|
SendKeyEvents | boolean |
If set to true then send key events (a lower level API which sends simulated keystrokes to the operating system) will be used. If set to false then send keys (a higher level API which sends keystrokes to the focused element) will be used instead. |
|
Interval in milliseconds
|
Interval | integer |
The number of milliseconds between each key press. |
|
Dont interpret symbols
|
DontInterpretSymbols | boolean |
Should symbols in the 'Text to input' not be interpreted as special keys (e.g. + for Shift, ^ for Ctrl)? This should be set to true if you are attempting to input the actual symbols. |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Validate clickable point within element boundary
|
ValidateClickablePointWithinElementBoundary | boolean |
For some elements, UIA is unaware of a clickable point within the element and will return an invalid coordinate (for example 0,0) instead of the center of the element. If this input is set to true, IA-Connect will check the validity of the coordinate provided by UIA and, if not within the element's boundary, will ignore the value provided by UIA and use the center of the element instead. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Global left mouse click on UIA element
Moves the mouse to the centre, or a chosen edge, corner or offset, relative to a UIA element and clicks the left mouse button.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Focus element first
|
FocusElementFirst | boolean |
Should IA-Connect attempt to focus the element before global clicking? |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Click offset X
|
ClickOffsetX | integer |
The number of X pixels to offset the click action by. This parameter supports both positive (right) and negative (left) offset values. |
|
Click offset Y
|
ClickOffsetY | integer |
The number of Y pixels to offset the click action by. This parameter supports both positive (down) and negative (up) offset values. |
|
Offset relative to
|
OffsetRelativeTo | string |
The relative position of the element to offset from (Center / Centre / Middle, Left, Right, Top, Bottom, Top Left, Top Right, Bottom Left, Bottom Right). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Validate clickable point within element boundary
|
ValidateClickablePointWithinElementBoundary | boolean |
For some elements, UIA is unaware of a clickable point within the element and will return an invalid coordinate (for example 0,0) instead of the center of the element. If this input is set to true, IA-Connect will check the validity of the coordinate provided by UIA and, if not within the element's boundary, will ignore the value provided by UIA and use the center of the element instead. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Global middle mouse click on UIA element
Moves the mouse to the centre, or a chosen edge, corner or offset, relative to a UIA element and clicks the middle mouse button.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Focus element first
|
FocusElementFirst | boolean |
Should IA-Connect attempt to focus the element before global clicking? |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Click offset X
|
ClickOffsetX | integer |
The number of X pixels to offset the click action by. This parameter supports both positive (right) and negative (left) offset values. |
|
Click offset Y
|
ClickOffsetY | integer |
The number of Y pixels to offset the click action by. This parameter supports both positive (down) and negative (up) offset values. |
|
Offset relative to
|
OffsetRelativeTo | string |
The relative position of the element to offset from (Center / Centre / Middle, Left, Right, Top, Bottom, Top Left, Top Right, Bottom Left, Bottom Right). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Validate clickable point within element boundary
|
ValidateClickablePointWithinElementBoundary | boolean |
For some elements, UIA is unaware of a clickable point within the element and will return an invalid coordinate (for example 0,0) instead of the center of the element. If this input is set to true, IA-Connect will check the validity of the coordinate provided by UIA and, if not within the element's boundary, will ignore the value provided by UIA and use the center of the element instead. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Global mouse click UIA element search colour region
Moves the mouse over a region of pixels within a UIA element that meet the specified colour criteria and performs a mouse click. The element should be brought to the front first as the screenshot is taking a copy of the screen at the elements location.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Search colour
|
SearchColour | True | string |
Search colour in the format 0xAARRGGBB, #AARRGGBB, 0xRRGGBB or #RRGGBB where each colour channel is a byte in hex format (00 is fully off, FF is fully on). For example: #FF0000 for red, #00FF00 for blue, #000000 for black, #FFFFFF for white. |
Max colour deviation
|
MaxColourDeviation | True | integer |
The maximum an element colour can deviate from the search colour before it isn't considered a match. 0 for no deviation. Deviation is measured in RGB values. For example: #FF0000 is 4 different from #FE0102. A deviation of 15 would be a good starting point. |
Left pixel X offset
|
LeftPixelXOffset | integer |
An optional X offset for the left edge of the search area. This allows you to increase (with negative values) or decrease (with positive values) the search area. |
|
Right pixel X offset
|
RightPixelXOffset | integer |
An optional X offset for the right edge of the search area. This allows you to increase (with positive values) or decrease (with negative values) the search area. |
|
Top pixel Y offset
|
TopPixelYOffset | integer |
An optional Y offset for the top edge of the search area. This allows you to increase (with negative values) or decrease (with positive values) the search area. |
|
Bottom pixel Y offset
|
BottomPixelYOffset | integer |
An optional Y offset for the bottom edge of the search area. This allows you to increase (with positive values) or decrease (with negative values) the search area. |
|
Mouse button
|
MouseButton | string |
The mouse button to press (Left, Right, Middle, Double left). |
|
Click offset X
|
ClickOffsetX | integer |
The number of X pixels to offset the click action by. This parameter supports both positive (right) and negative (left) offset values. |
|
Click offset Y
|
ClickOffsetY | integer |
The number of Y pixels to offset the click action by. This parameter supports both positive (down) and negative (up) offset values. |
|
Offset relative to
|
OffsetRelativeTo | string |
The relative position of the colour region to offset from (Center / Centre / Middle, Left, Right, Top, Bottom, Top Left, Top Right, Bottom Left, Bottom Right). |
|
Delay in milliseconds
|
DelayInMilliseconds | integer |
If performing a double click, the delay (in milliseconds) between each of the clicks. |
|
Hide Agent
|
HideAgent | boolean |
Set to true to automatically hide the Agent (if visible) to ensure it doesn't obscure the element being analysed. |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Command result
|
UIAGlobalMouseClickElementSearchColourRegionResult | boolean |
The result of the command (success or failure). |
Error message
|
ErrorMessage | string |
If the command was not successful, this will contain the error message that was returned. |
Global right mouse click on UIA element
Moves the mouse to the centre, or a chosen edge, corner or offset, relative to a UIA element and clicks the right mouse button.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Focus element first
|
FocusElementFirst | boolean |
Should IA-Connect attempt to focus the element before global clicking? |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Click offset X
|
ClickOffsetX | integer |
The number of X pixels to offset the click action by. This parameter supports both positive (right) and negative (left) offset values. |
|
Click offset Y
|
ClickOffsetY | integer |
The number of Y pixels to offset the click action by. This parameter supports both positive (down) and negative (up) offset values. |
|
Offset relative to
|
OffsetRelativeTo | string |
The relative position of the element to offset from (Center / Centre / Middle, Left, Right, Top, Bottom, Top Left, Top Right, Bottom Left, Bottom Right). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Validate clickable point within element boundary
|
ValidateClickablePointWithinElementBoundary | boolean |
For some elements, UIA is unaware of a clickable point within the element and will return an invalid coordinate (for example 0,0) instead of the center of the element. If this input is set to true, IA-Connect will check the validity of the coordinate provided by UIA and, if not within the element's boundary, will ignore the value provided by UIA and use the center of the element instead. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Input password into UIA element
UIA action which inputs a password into an element (typically a password entry field), replacing the existing text.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Password to input
|
PasswordToInput | True | password |
The password value to input. |
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Password contains stored password
|
PasswordContainsStoredPassword | boolean |
Set to true if the password contains (or is entirely) an IA-Connect stored password identifier, in the format {IAConnectPassword:StoredPasswordIdentifier} or an IA-Connect Orchestrator generic credential, in the format {OrchestratorCredential:FriendlyName}. This stored password could have been generated by the 'Generate password' action, for example, or be held by the IA-Connect Orchestrator. |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Try value pattern
|
TryValuePattern | boolean |
If set to true (the default), the IA-Connect Agent will attempt to use a UIA value pattern to perform the text input action. If the UIA value pattern is unavailable in the chosen element, the IA-Connect Agent will fall back to other patterns (enabled or disabled via other inputs to this action). If set to false, the IA-Connect Agent will not attempt to use a value pattern and will immediately fall back to other chosen patterns. |
|
Try legacy pattern
|
TryLegacyPattern | boolean |
If set to true, the IA-Connect Agent will attempt to use a UIA legacy pattern to perform the text input action if the value pattern is not available (either because it isn't present on the element or because its use was disabled). |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Input return into UIA element
Inputs a Windows return / new line into an element (typically a text entry field), either replacing the existing text or inserting the return at a specific position.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Replace existing value
|
ReplaceExistingValue | boolean |
If there is existing text in the element, should this be replaced? |
|
Insert position
|
InsertPosition | integer |
The position (index) to begin inserting text. If there is existing text, the insert position can be used to insert at a specific position within the existing text. |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Raise exception if input validation fails
|
RaiseExceptionIfInputValidationFails | boolean |
If enabled, the IA-Connect Agent will check the new value of the element after inputting the requested text. If the new value doesn't match the expected value, an exception will be raised. If this input is false (the default), a warning will be entered into the log, but no exception will be raised. |
|
Try value pattern
|
TryValuePattern | boolean |
If set to true (the default), the IA-Connect Agent will attempt to use a UIA value pattern to perform the text input action. If the UIA value pattern is unavailable in the chosen element, the IA-Connect Agent will fall back to other patterns (enabled or disabled via other inputs to this action). If set to false, the IA-Connect Agent will not attempt to use a value pattern and will immediately fall back to other chosen patterns. |
|
Try legacy pattern
|
TryLegacyPattern | boolean |
If set to true, the IA-Connect Agent will attempt to use a UIA legacy pattern to perform the text input action if the value pattern is not available (either because it isn't present on the element or because its use was disabled). |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Input text into multiple UIA elements
UIA Action which inputs different pieces of text into multiple elements (typically text entry fields), either replacing the existing text or inserting the new value at a specific position.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Input elements
|
InputElementsJSON | True | string |
An array of UIA elements to enter text into, in JSON format. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Input text into UIA element
UIA action which inputs text into an element (typically a text entry field), either replacing the existing text or inserting the new value at a specific position.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Text to input
|
TextToInput | string |
The text value to input. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Replace existing value
|
ReplaceExistingValue | boolean |
If there is existing text in the element, should this be replaced? |
|
Insert position
|
InsertPosition | integer |
The position (index) to begin inserting text. If there is existing text, the insert position can be used to insert at a specific position within the existing text. |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Raise exception if input validation fails
|
RaiseExceptionIfInputValidationFails | boolean |
If enabled, the IA-Connect Agent will check the new value of the element after inputting the requested text. If the new value doesn't match the expected value, an exception will be raised. If this input is false (the default), a warning will be entered into the log, but no exception will be raised. |
|
Try value pattern
|
TryValuePattern | boolean |
If set to true (the default), the IA-Connect Agent will attempt to use a UIA value pattern to perform the text input action. If the UIA value pattern is unavailable in the chosen element, the IA-Connect Agent will fall back to other patterns (enabled or disabled via other inputs to this action). If set to false, the IA-Connect Agent will not attempt to use a value pattern and will immediately fall back to other chosen patterns. |
|
Try legacy pattern
|
TryLegacyPattern | boolean |
If set to true, the IA-Connect Agent will attempt to use a UIA legacy pattern to perform the text input action if the value pattern is not available (either because it isn't present on the element or because its use was disabled). |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Is UIA element checked
This action returns true or false indicating whether an element (typically a checkbox or radio box) is checked.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Element is checked
|
ElementIsChecked | boolean |
Returns true if the element is checked or false if not. |
Maximise UIA window
Maximises the window with the specified UIA handle.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Window handle
|
WindowHandle | True | integer |
The UIA handle for the window to be maximised. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Minimise UIA window
Minimises the window with the specified UIA handle.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Window handle
|
WindowHandle | True | integer |
The UIA handle for the window to be minimised. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Move UIA element
Moves a UIA element to a specified position on the screen. This action will typically only work with Window elements (which have the transform pattern).
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Horizontal movement type
|
HorizontalMovementType | string |
The type of movement: Absolute or relative. |
|
Horizontal position
|
HorizontalPosition | True | integer |
The new horizontal position for the element. The type of movement (for example, absolute or relative) is defined by the input 'Horizontal movement type'. To leave the horizontal position unchanged, choose a value of 0 and set 'Horizontal movement type' to 'Relative'. |
Vertical movement type
|
VerticalMovementType | string |
The type of movement: Absolute or relative. |
|
Vertical position
|
VerticalPosition | True | integer |
The new vertical position for the element. The type of movement (for example, absolute or relative) is defined by the input 'Vertical movement type'. To leave the vertical position unchanged, choose a value of 0 and set 'Vertical movement type' to 'Relative'. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Command result
|
UIAMoveElementResult | boolean |
The result of the command (success or failure). |
Error message
|
ErrorMessage | string |
If the command was not successful, this will contain the error message that was returned. |
Press UIA element
Presses an element (typically a button).
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Wait for button event to complete
|
Wait | boolean |
Should the automation wait for the button event to complete before continuing. If set to true this can cause a timeout if the button opens a modal dialog. |
|
Win32 click button
|
Win32ClickButton | boolean |
If set to true, a Win32 click event is used instead of using UIA. This is a 'fire and forget' click event, which can be useful when dealing with modal dialogs that are presented after a click, or elements which don't have a UIA invoke pattern. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Try invoke pattern
|
TryInvokePattern | boolean |
If set to true (the default), the IA-Connect Agent will attempt to use a UIA invoke pattern to perform the press action (unless 'Win32 click button' is set to true). If the UIA invoke pattern is unavailable in the chosen element, the IA-Connect Agent will fall back to other patterns (enabled or disabled via other inputs to this action). If set to false, the IA-Connect Agent will not attempt to use an invoke pattern and will immediately fall back to other chosen patterns. |
|
Try legacy pattern
|
TryLegacyPattern | boolean |
If set to true, the IA-Connect Agent will attempt to use a UIA legacy pattern to perform the press action if the invoke pattern is not available (either because it isn't present on the element or because its use was disabled) and if 'Win32 click button' is false. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Reset all UIA element handles
Resets all UIA element handles currently stored by IA-Connect which can be useful if you have been identifying a lot of elements and have a large number of element handles stored. In scenarios with extremely high numbers of element handles (100,000+) this action can also be used to free up RAM usage.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Resize UIA element
Resizes a UIA element. This action will typically only work with Window elements (which have the transform pattern).
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Resize width type
|
ResizeWidthType | string |
The type of width resize: Absolute or relative. |
|
New width
|
NewWidth | True | integer |
The new width of the element. The type of resizing (for example, absolute or relative) is defined by the input 'Resize width type'. To leave the width unchanged, choose a value of 0 and set 'Resize width type' to 'Relative'. |
Resize height type
|
ResizeHeightType | string |
The type of height resize: Absolute or relative. |
|
New height
|
NewHeight | True | integer |
The new height of the element. The type of resizing (for example, absolute or relative) is defined by the input 'Resize height type'. To leave the height unchanged, choose a value of 0 and set 'Resize height type' to 'Relative'. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Command result
|
UIAResizeElementResult | boolean |
The result of the command (success or failure). |
Error message
|
ErrorMessage | string |
If the command was not successful, this will contain the error message that was returned. |
Search for first UIA parent element
Searches up the UIA tree hierarchy for the first parent element which matches the search criteria. The parent element is defined as the element which is at the next level up the UIA 'tree' and is almost always a containing element.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Element handle
|
ElementHandle | True | integer |
The UIA handle for the target element. |
Search parent element localized control type
|
SearchParentLocalizedControlType | string |
The parent UIA element localized control type to search for. This can be discovered via Inspection. |
|
Search parent element control type
|
SearchParentControlType | integer |
The parent UIA element control type (an non-localized integer) to search for. This is the same value across different languages. |
|
Max parents to process
|
MaxParentsToProcess | integer |
The maximum number of parent elements to process. By default, this is set to 50. |
|
Raise exception if parent element not found
|
RaiseExceptionIfParentElementNotFound | boolean |
Should IA-Connect raise an exception if the search UIA element is not located? |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Parent element found
|
ParentElementFound | boolean |
Returns true if the search parent UIA element was found. |
Parent element handle
|
ParentElementHandle | integer |
The UIA handle for the located parent element. This can be used as an input to further UIA actions acting on this element. |
Parent element name
|
ParentElementName | string |
The UIA name of the located parent element. |
Parent element class name
|
ParentElementClassName | string |
The UIA class name of the located parent element. |
Parent element automation Id
|
ParentElementAutomationId | string |
The UIA automation Id of the located parent element. |
Parent element localized control type
|
ParentElementLocalizedControlType | string |
The UIA localized control type of the located parent element. |
Select UIA element
Selects an element (typically an item in a list or drop-down).
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Set foreground UIA window
Brings a window to the foreground.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Window handle
|
WindowHandle | True | integer |
The UIA handle for the window which should be set as the foreground window. |
Toggle window
|
ToggleWindow | boolean |
Should the window be toggled by attempting to focus or click it? This helps to ensure that the window is reliably brought to the foreground. |
|
Toggle uses global left mouse click agent
|
ToggleUsesGlobalLeftMouseClickAgent | boolean |
If choosing to toggle the window, this specifies whether to use global mouse clicks to focus the IA-Connect Agent first. |
|
Toggle delay in seconds
|
ToggleDelay | double |
If choosing to toggle the window, this specifies the pause after toggling. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Set UIA element scroll percentage
Set the horizontal and / or vertical scroll percentage of the specified element, if scrolling is supported by that element. If the element supports the 'scroll' pattern, you can apply this action directly to the element and specify either a horizontal or vertical scroll amount (or both). If the element doesn't support the 'scroll' pattern this action will fall back to the 'range value' or 'value' patterns, but you will need to apply these directly to the scroll bar control(s), not the element itself.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Horizontal scroll percentage
|
HorizontalScrollPercentage | double |
The position to horizontally scroll the element (0 to 100 inclusive, decimals supported) or -1 to leave the horizontal scroll position unchanged. |
|
Vertical scroll percentage
|
VerticalScrollPercentage | double |
The position to vertically scroll the element (0 to 100 inclusive, decimals supported) or -1 to leave the vertical scroll position unchanged. |
|
Try scroll pattern
|
TryScrollPattern | boolean |
If set to true, the IA-Connect Agent will attempt to use a UIA scroll pattern to perform the scroll action. If the UIA scroll pattern is unavailable in the chosen element, the IA-Connect Agent will fall back to other chosen patterns (enabled or disabled via other inputs to this action). If set to false, the IA-Connect Agent will not attempt to use a scroll pattern and will immediately fall back to other chosen patterns. The order of patterns attempted (if enabled via inputs to this action) are scroll, range value and value. |
|
Try range value pattern
|
TryRangeValuePattern | boolean |
If set to true, the IA-Connect Agent will attempt to use a UIA range value pattern to perform the scroll action. If the UIA range value pattern is unavailable in the chosen element, the IA-Connect Agent will fall back to other chosen patterns (enabled or disabled via other inputs to this action). If set to false, the IA-Connect Agent will not attempt to use a range value pattern and will immediately fall back to other chosen patterns. The order of patterns attempted (if enabled via inputs to this action) are scroll, range value and value. |
|
Try value pattern
|
TryValuePattern | boolean |
If set to true, the IA-Connect Agent will attempt to use a UIA value pattern to perform the scroll action. If the UIA value pattern is unavailable in the chosen element, the IA-Connect Agent will fall back to other chosen patterns (enabled or disabled via other inputs to this action). If set to false, the IA-Connect Agent will not attempt to use a value pattern and will immediately fall back to other chosen patterns. The order of patterns attempted (if enabled via inputs to this action) are scroll, range value and value. Warning: Using a value pattern on an edit element will simply enter the value into the edit element. |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Command result
|
UIASetElementScrollPercentageResult | boolean |
The result of the command (success or failure). |
Error message
|
ErrorMessage | string |
If the command was not successful, this will contain the error message that was returned. |
Set UIA element search mode
Choose which UIA element search mode should be used by the IA-Connect Agent when performing UIA actions. Typically, this action would only be used if you are having a problem with the default mode (Find all).
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
UIA element search mode
|
UIAElementSearchMode | True | string |
The UIA element search mode to use. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Command result
|
SetUIAElementSearchModeResult | boolean |
The result of the command (success or failure). |
Error message
|
ErrorMessage | string |
If the command was not successful, this will contain the error message that was returned. |
Set UIA element to numeric range value
Sets the value of the element which has a numeric range, for example a scrollbar.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
New value
|
NewValue | True | double |
The numeric range value to set the element to. |
New value is percentage
|
NewValueIsPercentage | boolean |
Is the new value a percentage? |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Set UIA element to numeric value
Sets the value of the element which has a numeric input, for example a text field or a scrollbar.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
New value
|
NewValue | True | integer |
The numeric value to set the element to. |
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Raise exception if input validation fails
|
RaiseExceptionIfInputValidationFails | boolean |
If enabled, the IA-Connect Agent will check the new value of the element after inputting the requested text. If the new value doesn't match the expected value, an exception will be raised. If this input is false (the default), a warning will be entered into the log, but no exception will be raised. |
|
Try value pattern
|
TryValuePattern | boolean |
If set to true (the default), the IA-Connect Agent will attempt to use a UIA value pattern to perform the text input action. If the UIA value pattern is unavailable in the chosen element, the IA-Connect Agent will fall back to other patterns (enabled or disabled via other inputs to this action). If set to false, the IA-Connect Agent will not attempt to use a value pattern and will immediately fall back to other chosen patterns. |
|
Try legacy pattern
|
TryLegacyPattern | boolean |
If set to true, the IA-Connect Agent will attempt to use a UIA legacy pattern to perform the text input action if the value pattern is not available (either because it isn't present on the element or because its use was disabled). |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Set UIA transaction timeout
Controls how long the UIA API will wait for an application to return the information about an element. This transaction timeout would typically only be reached if the application was non-responsive.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Timeout in seconds
|
TimeoutInSeconds | True | double |
The maximum length of time that the UIA API will wait for an application to return the information about an element. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Set UIA window to normal
Normalises the window with the specified UIA handle (i.e. sets it to a normal sized window instead of minimised or maximised).
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Window handle
|
WindowHandle | True | integer |
The UIA handle for the window to be normalised. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Take screenshot of UIA element location
Takes a screenshot of the location of an element and returns an image. The element should be brought to the front first as the screenshot is taking a copy of the screen at the elements location.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Image format
|
ImageFormat | string |
The image format to use for the screenshot. This can affect the quality and size of data being returned. Supported formats are PNG (the default), JPG, BMP and GIF. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Hide Agent
|
HideAgent | boolean |
Set to true to automatically hide the Agent (if visible) to ensure it doesn't obscure the screenshot. |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Screen image as Base64
|
ScreenBitmapBase64 | string |
The screen image as a Base64 encoded string. |
Toggle UIA element
Toggles an element (typically a checkbox or a radio box). This gives the element the opposite state to its current state (e.g. checked becomes unchecked and vice-versa). If you want to set a specific state, use the action 'Check element' instead.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Wait for UIA desktop element
Waits for a desktop element (typically a window) to exist.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search process Id
|
SearchProcessId | integer |
If specified (a value of 1 or higher) then the search will only consider elements owned by a process with this Process ID (PID). If IA-Connect launched the process then the PID is provided by the 'Run Process' action in the IA-Connect Environment / Session actions. If you don't know the PID then leave this field blank (or 0). |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Return element handle
|
ReturnElementHandle | boolean |
If set to true, a handle to the located element will be returned. This handle can be used in further actions to act as a 'parent' handle. |
|
Seconds to wait
|
SecondsToWait | True | integer |
The maximum number of seconds to wait for the element to exist. |
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Include child processes
|
IncludeChildProcesses | boolean |
If set to true and a 'Search process Id' is specified, child processes of that process Id are also included in the search. If set to false then only a process matching the exact 'Search process Id' will be returned. |
|
Raise exception if element not found
|
RaiseExceptionIfElementNotFound | boolean |
Should IA-Connect raise an exception if the UIA element does not exist after the wait period? |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Element exists
|
ElementExists | boolean |
Returns true if the element exists or false if not. |
Element handle
|
ElementHandle | integer |
The UIA handle for the element. This can be used as an input to further UIA actions acting on this element. |
Element name
|
ElementName | string |
The UIA name of the element. |
Element class name
|
ElementClassName | string |
The UIA class name of the element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the element. |
Wait for UIA desktop element to not exist
Waits for a desktop element (typically a window) to no longer exist.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search process Id
|
SearchProcessId | integer |
If specified (a value of 1 or higher) then the search will only consider elements owned by a process with this Process ID (PID). If IA-Connect launched the process then the PID is provided by the 'Run Process' action in the IA-Connect Environment / Session actions. If you don't know the PID then leave this field blank (or 0). |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Seconds to wait
|
SecondsToWait | True | integer |
The maximum number of seconds to wait for the element to not exist. |
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Include child processes
|
IncludeChildProcesses | boolean |
If set to true and a 'Search process Id' is specified, child processes of that process Id are also included in the search. If set to false then only a process matching the exact 'Search process Id' will be returned. |
|
Raise exception if element still exists
|
RaiseExceptionIfElementStillExists | boolean |
Should IA-Connect raise an exception if the UIA element still exists after the wait period? |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Element exists before wait
|
ElementExistsBeforeWait | boolean |
Returns true if the element existed before waiting or false if not. |
Element exists after wait
|
ElementExistsAfterWait | boolean |
Returns true if the element existed after waiting or false if not. |
Wait for UIA element
Waits for an element (typically an individual element within a window such as a button or a text input area) to exist.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search process Id
|
SearchProcessId | integer |
If specified (a value of 1 or higher) then the search will only consider elements owned by a process with this Process ID (PID). If IA-Connect launched the process then the PID is provided by the 'Run Process' action in the IA-Connect Environment / Session actions. If you don't know the PID then leave this field blank (or 0). |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Return element handle
|
ReturnElementHandle | boolean |
If set to true, a handle to the located element will be returned. This handle can be used in further actions to act as a 'parent' handle. |
|
Seconds to wait
|
SecondsToWait | True | integer |
The maximum number of seconds to wait for the element to exist. |
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Include child processes
|
IncludeChildProcesses | boolean |
If set to true and a 'Search process Id' is specified, child processes of that process Id are also included in the search. If set to false then only a process matching the exact 'Search process Id' will be returned. |
|
Raise exception if element not found
|
RaiseExceptionIfElementNotFound | boolean |
Should IA-Connect raise an exception if the UIA element does not exist after the wait period? |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Element exists
|
ElementExists | boolean |
Returns true if the element exists or false if not. |
Element handle
|
ElementHandle | integer |
The UIA handle for the element. This can be used as an input to further UIA actions acting on this element. |
Element name
|
ElementName | string |
The UIA name of the element. |
Element class name
|
ElementClassName | string |
The UIA class name of the element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the element. |
Wait for UIA element to not exist
Waits for an element (typically an individual element within a window such as a button or a text input area) to no longer exist.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Parent window handle
|
ParentWindowHandle | True | integer |
The parent UIA window handle (a value of 1 or higher) to act as the starting point for the search. This can be discovered via Inspection using actions like 'Wait for desktop element' or 'Wait for element'. |
Search element name
|
SearchElementName | string |
The optional UIA element name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element class name
|
SearchElementClassName | string |
The optional UIA element class name to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element automation ID
|
SearchElementAutomationId | string |
The optional UIA element automation ID to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search element localized control type
|
SearchLocalizedControlType | string |
The optional UIA element localized control type to search for (starting from the parent window handle). This can be discovered via Inspection. |
|
Search process Id
|
SearchProcessId | integer |
If specified (a value of 1 or higher) then the search will only consider elements owned by a process with this Process ID (PID). If IA-Connect launched the process then the PID is provided by the 'Run Process' action in the IA-Connect Environment / Session actions. If you don't know the PID then leave this field blank (or 0). |
|
Search UIA subtree
|
SearchSubTree | boolean |
If set to true then the whole UIA tree below the parent window handle will be searched. This is more thorough but can take longer. If set to false, only elements directly below the parent window handle in the UIA tree will be searched. |
|
Seconds to wait
|
SecondsToWait | True | integer |
The maximum number of seconds to wait for the element to not exist. |
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators and any element field. Example 1: [Width] < 200. Example 2: [Name] like 'Document*' AND [ClassName] like 'Label*'. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple elements match the search, this allows you to specify which element property to sort by. This will be used in conjunction with 'Match index' to pick the required element. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching element nearest the top of the screen will be matched. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple elements match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Include child processes
|
IncludeChildProcesses | boolean |
If set to true and a 'Search process Id' is specified, child processes of that process Id are also included in the search. If set to false then only a process matching the exact 'Search process Id' will be returned. |
|
Raise exception if element still exists
|
RaiseExceptionIfElementStillExists | boolean |
Should IA-Connect raise an exception if the UIA element still exists after the wait period? |
|
Maximum elements to search
|
MaxElementsToSearch | integer |
The maximum number of elements to search when looking for the target element in the UIA tree. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Maximum relative search depth
|
MaxRelativeSearchDepth | integer |
The maximum relative tree depth to search for child elements beneath the parent element. Direct child elements will have a depth value of 1. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). Set to 0 for an unlimited search depth. This input is typically used to optimise element searching. |
|
Maximum child elements to search per node
|
MaxChildElementsToSearchPerNode | integer |
The maximum number of child elements to search beneath each element when searching the UIA tree for the target element. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). By default, this is set to 0 (unlimited). This input is typically used to optimise element searching. |
|
Element localized control types not to traverse
|
ElementLocalizedControlTypesNotToTraverse | string |
A comma separated list of UIA element localized control types to not traverse (step into) when searching the UIA tree for the target element. The search will still check if an individual element matches the search criteria, however it will not search any child elements of that element if its localized control type is on this exclusion list. This input only works if the UIA element search mode is "Tree walk" (this can be enabled in the settings page in the Inspector). This input is typically used to optimise element searching. |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Element exists before wait
|
ElementExistsBeforeWait | boolean |
Returns true if the element existed before waiting or false if not. |
Element exists after wait
|
ElementExistsAfterWait | boolean |
Returns true if the element existed after waiting or false if not. |
Wait for UIA process Id main window
A simple and fast Win32 action which waits for a main window of a process (specified by Process ID) to exist and returns a handle. The 'Main' window is typically the main application window: a login dialog or sub-window is generally not the 'Main' window. It is recommended to use the action 'Wait for desktop element' which is more powerful.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Search process Id
|
ProcessId | True | integer |
The Id of the process to wait for (as provided by the 'Run Process' action in the IA-Connect Environment / Session actions). |
Seconds to wait
|
SecondsToWait | True | integer |
The maximum number of seconds to wait for the process main window. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Element exists
|
ElementExists | boolean |
Returns true if the element exists or false if not. |
Window handle
|
WindowHandle | integer |
The UIA handle for the window. This can be used as an input to further UIA actions within this window. |
Element name
|
ElementName | string |
The UIA name of the window element. |
Element class name
|
ElementClassName | string |
The UIA class name of the window element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the window element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the window element. |
Wait for UIA process main window
A simple and fast Win32 action which waits for a specified time for the main window of a process (specified by name) to exist before returning a handle. The 'Main' window is typically the main application window: a login dialog or sub-window is generally not the 'Main' window. It is recommended to use the action 'Wait for desktop element' which is more powerful.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Search process name
|
SearchProcessName | True | string |
The name of the process to search for, e.g. notepad. |
Seconds to wait
|
SecondsToWait | True | integer |
The maximum number of seconds to wait for the process main window. |
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Window handle
|
WindowHandle | integer |
The UIA handle for the window. This can be used as an input to further UIA actions within this window. |
Element name
|
ElementName | string |
The UIA name of the window element. |
Element class name
|
ElementClassName | string |
The UIA class name of the window element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the window element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the window element. |
Element exists
|
ElementExists | boolean |
Returns true if the window exists or false if not. |
Wait for UIA top level Win32 window
A fast Win32 action which waits for a specified time for a top-level Win32 window to exist before returning a UIA handle. A top-level window is one which is connected to the desktop. You can search by class name or window title, or you can specify more advanced search filters, including wildcards. Although this action uses Win32 APIs, it can detect Windows, Java, ModernUI and Web windows. It is more common to use the UIA action 'Wait for desktop element' which is more powerful, but this Win32 action typically executes faster.
Parameters
Name | Key | Required | Type | Description |
---|---|---|---|---|
Search class name
|
SearchClassName | string |
The element class name of the top level window to search for, e.g. 'Notepad'. |
|
Search window title
|
SearchWindowTitle | string |
The title of the top level window to search for. |
|
Seconds to wait
|
SecondsToWait | True | integer |
The maximum number of seconds to wait for the window to exist. |
Search process Id
|
SearchProcessId | integer |
The optional process Id of the process which owns the window (for example, as provided by the output of the 'Run Process' action in the IA-Connect Environment / Session actions). Set to 0 to not search by process Id. |
|
Match index
|
MatchIndex | integer |
If multiple elements match the search, which element (starting at 1) should be matched. Can be used in conjunction with 'Sort by column' to choose the sort order for matching. |
|
Search filter
|
SearchFilter | string |
An optional advanced filter to further restrict the search using conditional operators against available window properties. Example 1: [Width] < 200. Example 2: [Title] like '*Excel' AND [IsMinimised] = False AND [IsResizeable] = True. See the documentation for more examples. |
|
Sort by column name
|
SortByColumn | string |
If multiple windows match the search, this allows you to specify which window property to sort by. This will be used in conjunction with 'Match index' to pick the required window. For example: If 'Sort by column name' is [TopEdge] and 'Match index' is 1 then the matching window nearest the top of the screen will be returned. |
|
Match index is ascending
|
MatchIndexAscending | boolean |
If multiple windows match the search, should 'Match index' match from the top of the sorted list (true) or from the bottom of the sorted list (false). |
|
Raise exception if window not found
|
RaiseExceptionIfWindowNotFound | boolean |
Should IA-Connect raise an exception if the search Win32 window does not exist after the wait period? |
|
Workflow
|
Workflow | True | string |
Add the following expression here: workflow() |
Returns
Name | Path | Type | Description |
---|---|---|---|
Window handle
|
WindowHandle | integer |
The UIA handle for the window. This can be used as an input to further UIA actions within this window. |
Element name
|
ElementName | string |
The UIA name of the window element. |
Element class name
|
ElementClassName | string |
The UIA class name of the window element. |
Element automation Id
|
ElementAutomationId | string |
The UIA automation Id of the window element. |
Element localized control type
|
ElementLocalizedControlType | string |
The UIA localized control type of the window element. |
Element exists
|
ElementExists | boolean |
Returns true if the window exists or false if not. |