UI Automation activities

Drag and Drop

link

• Source work in scope - Select the browser tab or application window that hosts the application containing the source element, when the activity is placed inside nested Use Application/Browser activities.

• Source element - * Indicate target on screen - Indicate the source UI element. After you indicate the target, click the hamburger menu next to the informative screenshot to access the following options:

  • Indicate target - Indicate the target again. If the Descriptor is defined in the Object Repository, you must first unlink it from the Object Repository if you want to specify a Descriptor only for the current activity.
  • Edit target - Open the selection mode to configure the target.
  • Remove Informative Screenshot - Remove the screenshot of the target application or web page.
  • Change Informative Screenshot - Change the screenshot of the target application or web page.
  • Add to Object Repository - Add the current UI element to the Object Repository, from where it can be reused throughout your automation process. This option is only displayed when the object has not yet been added to the Object Repository.
  • Show in Object Repository - Open the Object Repository panel with the Descriptor selected. This option is only displayed when the object has been added to the Object Repository.
  • Unlink from Object Repository - Unlink the Descriptor from the Object Repository. This option is only displayed when the object has been added to the Object Repository.

• Destination work in scope - Select the browser tab or application window that hosts the application containing the destination element, when the activity is placed inside nested Use Application/Browser activities.

• Destination element - * Indicate target on screen - Indicate the destination UI element. After you indicate the target, click the hamburger menu next to the informative screenshot to access the following options:

  • Indicate target - Indicate the target again. If the Descriptor is defined in the Object Repository, you must first unlink it from the Object Repository if you want to specify a Descriptor only for the current activity.
  • Edit target - Open the selection mode to configure the target.
  • Remove Informative Screenshot - Remove the screenshot of the target application or web page.
  • Change Informative Screenshot - Change the screenshot of the target application or web page.
  • Add to Object Repository - Add the current UI element to the Object Repository, from where it can be reused throughout your automation process. This option is only displayed when the object has not yet been added to the Object Repository.
  • Show in Object Repository - Open the Object Repository panel with the Descriptor selected. This option is only displayed when the object has been added to the Object Repository.
  • Unlink from Object Repository - Unlink the Descriptor from the Object Repository. This option is only displayed when the object has been added to the Object Repository.

Properties panel​

• Expand target properties/Collapse target properties button - Displays/hides the source element target and its anchor(s) properties.

• Targeting methods - The selector types that you want to use for identifying the element. This property can be set to any combination, and at least one targeting method must be selected:

  • Strict selector

  • Fuzzy selector

  • Image (only available for Windows projects)

  • Native text (only available for Windows projects)

  • Computer Vision

  • Semantic selector

    Note:

    To use Computer Vision as a targeting method, you need to go to Project Settings > Computer Vision and make sure to set the correct server endpoint. You can leave this field as it is and use UiPath Cloud, which is filled-in by default, or you can enter another value either by selecting any of the other public endpoints specific to a server region or your own on-premises server.

    Another way of using Computer Vision as a targeting method is to set Use Local Server to True. This implies that the UiPath.ComputerVision.LocalServer package is installed in your project. When Local Server is enabled, the server value is overwritten. However, the Local Server is not available in cross-platform projects.

• Window selector (Application instance) - The selector that is used for the application window. Only applicable when the window attach mode is set to Application instance.

• Strict selector - The strict selector generated for the UI element. It is only displayed if Strict selector targeting method has been selected.

• Fuzzy selector - The parameters for the fuzzy selector. It is only displayed if Fuzzy selector targeting method has been selected.

• Image - These properties are available only when the Image targeting method is selected.

  • Image accuracy - Specifies the confidence threshold used for image matching. The default value is 0.8.
  • Image occurrence - Specifies which match to use when multiple matching images are found.

• Native - These properties are available only when the Native targeting method is selected.

  • Native text - Specifies the text used to identify the UI element.
  • Native text occurrence - Specifies which occurrence to use when multiple matches are found.
  • Native text case-sensitive - Specifies whether text matching is case-sensitive.

• Computer Vision - These properties are available only when the Computer Vision targeting method is selected.

  • CV Control type - Specifies the type of control identified using Computer Vision.
  • CV Text - Specifies the text identified using Computer Vision.
  • CV Text accuracy - Specifies the confidence threshold used for OCR text matching. The default value is 0.7.
  • CV Text occurence - Specifies which occurrence to use when multiple matches are found.

• Semantic selector - A semantic description that defines the target. This property is available only when the Semantic targeting method has been selected.

  Large Language Models (LLMs) are used to generate default functional, human‑readable descriptions of UI elements. These descriptions are highly resilient to UI changes and help improve automation reliability when traditional selectors are insufficient or fail.

• Wait for page load - Before performing the action, wait for the application to become ready to accept input. You can choose one of three options from the drop-down menu:

  • None - Does not wait for the target to be ready.
  • Interactive - Waits until only a part of the app is loaded.
  • Complete - Waits for the entire app to be loaded.

• Visibility check - Checks whether the UI element is visible or not. You can choose one of three options from the drop-down menu:

  • None - Does not check for visibility.
  • Interactive (for Fuzzy Selector) - Default option. Checks if the element is potentially visible, ignoring page scroll and obstructions by other apps, or the fact that the application is minimized. This check is useful when trying to ensure that you are not targeting invisible elements that exist in the DOM but are hidden.
  • Fully visible - Checks if the UI element is visible or not.

• Responsive websites - Enable responsive websites layout.

• Targeting methods - The selector types that you want to use for identifying the element. This property can be set to any combination, and at least one targeting method must be selected:
  • Strict selector
  • Fuzzy selector
  • Image (only available for Windows projects)
  • Native text (only available for Windows projects)
  • Computer Vision
• Strict selector - The strict selector generated for the UI element. It is only displayed if Strict selector targeting method has been selected.
• Fuzzy selector - The parameters for the fuzzy selector. It is only displayed if Fuzzy selector targeting method has been selected.
• Image - These properties are available only when the Image targeting method is selected.
  • Image accuracy - Specifies the confidence threshold used for image matching. The default value is 0.8.
  • Image occurrence - Specifies which match to use when multiple matching images are found.
• Native - These properties are available only when the Native targeting method is selected.
  • Native text - Specifies the text used to identify the UI element.
  • Native text occurrence - Specifies which occurrence to use when multiple matches are found.
  • Native text case-sensitive - Specifies whether text matching is case-sensitive.
• Computer Vision - These properties are available only when the Computer Vision targeting method is selected.
  • CV Control type - Specifies the type of control identified using Computer Vision.
  • CV Text - Specifies the text identified using Computer Vision.
  • CV Text accuracy - Specifies the confidence threshold used for OCR text matching. The default value is 0.7.
  • CV Text occurence - Specifies which occurrence to use when multiple matches are found.

• Anchoring point - Describes the starting point of the cursor to which it offsets from Offset X and Offset Y properties are added. The following options are available: TopLeft, TopRight, BottomLeft, BottomRight, and Center. By default, Center is selected.
• Offset X - Horizontal displacement of the cursor position according to the option selected in the Anchoring point field. This field supports only Int32 variables.
• Offset Y - Vertical displacement of the cursor position according to the option selected in the Anchoring point field. This field supports only Int32 variables.

• Expand destination element target properties/Collapse target properties button - Displays/hides the destination element target and its anchor(s) properties.

• Targeting methods - The selector types that you want to use for identifying the element. This property can be set to any combination, and at least one targeting method must be selected:

  • Strict selector

  • Fuzzy selector

  • Image (only available for Windows projects)

  • Native text (only available for Windows projects)

  • Computer Vision

  • Semantic selector

    Note:

    To use Computer Vision as a targeting method, you need to go to Project Settings > Computer Vision and make sure to set the correct server endpoint. You can leave this field as it is and use UiPath Cloud, which is filled-in by default, or you can enter another value either by selecting any of the other public endpoints specific to a server region or your own on-premises server.

    Another way of using Computer Vision as a targeting method is to set Use Local Server to True. This implies that the UiPath.ComputerVision.LocalServer package is installed in your project. When Local Server is enabled, the server value is overwritten. However, the Local Server is not available in cross-platform projects.

• Window selector (Application instance) - The selector that is used for the application window. Only applicable when the window attach mode is set to Application instance.

• Strict selector - The strict selector generated for the UI element. It is only displayed if Strict selector targeting method has been selected.

• Fuzzy selector - The parameters for the fuzzy selector. It is only displayed if Fuzzy selector targeting method has been selected.

• Image - These properties are available only when the Image targeting method is selected.

  • Image accuracy - Specifies the confidence threshold used for image matching. The default value is 0.8.
  • Image occurrence - Specifies which match to use when multiple matching images are found.

• Native - These properties are available only when the Native targeting method is selected.

  • Native text - Specifies the text used to identify the UI element.
  • Native text occurrence - Specifies which occurrence to use when multiple matches are found.
  • Native text case-sensitive - Specifies whether text matching is case-sensitive.

• Computer Vision - These properties are available only when the Computer Vision targeting method is selected.

  • CV Control type - Specifies the type of control identified using Computer Vision.
  • CV Text - Specifies the text identified using Computer Vision.
  • CV Text accuracy - Specifies the confidence threshold used for OCR text matching. The default value is 0.7.
  • CV Text occurence - Specifies which occurrence to use when multiple matches are found.

• Semantic selector - A semantic description that defines the target. This property is available only when the Semantic targeting method has been selected.

  Large Language Models (LLMs) are used to generate default functional, human‑readable descriptions of UI elements. These descriptions are highly resilient to UI changes and help improve automation reliability when traditional selectors are insufficient or fail.

• Wait for page load - Before performing the action, wait for the application to become ready to accept input. You can choose one of three options from the drop-down menu:

  • None - Does not wait for the target to be ready.
  • Interactive - Waits until only a part of the app is loaded.
  • Complete - Waits for the entire app to be loaded.

• Visibility check - Checks whether the UI element is visible or not. You can choose one of three options from the drop-down menu:

  • None - Does not check for visibility.
  • Interactive (for Fuzzy Selector) - Default option. Checks if the element is potentially visible, ignoring page scroll and obstructions by other apps, or the fact that the application is minimized. This check is useful when trying to ensure that you are not targeting invisible elements that exist in the DOM but are hidden.
  • Fully visible - Checks if the UI element is visible or not.

• Responsive websites - Enable responsive websites layout.

• Targeting methods - The selector types that you want to use for identifying the element. This property can be set to any combination, and at least one targeting method must be selected:
  • Strict selector
  • Fuzzy selector
  • Image (only available for Windows projects)
  • Native text (only available for Windows projects)
  • Computer Vision
• Strict selector - The strict selector generated for the UI element. It is only displayed if Strict selector targeting method has been selected.
• Fuzzy selector - The parameters for the fuzzy selector. It is only displayed if Fuzzy selector targeting method has been selected.
• Image - These properties are available only when the Image targeting method is selected.
  • Image accuracy - Specifies the confidence threshold used for image matching. The default value is 0.8.
  • Image occurrence - Specifies which match to use when multiple matching images are found.
• Native - These properties are available only when the Native targeting method is selected.
  • Native text - Specifies the text used to identify the UI element.
  • Native text occurrence - Specifies which occurrence to use when multiple matches are found.
  • Native text case-sensitive - Specifies whether text matching is case-sensitive.
• Computer Vision - These properties are available only when the Computer Vision targeting method is selected.
  • CV Control type - Specifies the type of control identified using Computer Vision.
  • CV Text - Specifies the text identified using Computer Vision.
  • CV Text accuracy - Specifies the confidence threshold used for OCR text matching. The default value is 0.7.
  • CV Text occurence - Specifies which occurrence to use when multiple matches are found.

• Anchoring point - Describes the starting point of the cursor to which it offsets from Offset X and Offset Y properties are added. The following options are available: TopLeft, TopRight, BottomLeft, BottomRight, and Center. By default, Center is selected.
• Offset X - Horizontal displacement of the cursor position according to the option selected in the Anchoring point field. This field supports only Int32 variables.
• Offset Y - Vertical displacement of the cursor position according to the option selected in the Anchoring point field. This field supports only Int32 variables.

• Mouse button - The mouse button you want to use for the drag and drop action. The available options are Left, Right, and Middle.

• Delay between actions - Delay (in seconds) between the actions necessary to perform the drag and drop operation. The default value for this field is 0.3.

• Healing Agent mode - Configures the behavior of the Healing Agent for this activity, based on Governance or Orchestrator settings at process or job level.

  • Disabled - Turns off the Healing Agent for this activity.
  • Inherit job settings - Applies the settings defined in Governance or in Orchestrator at the process or job level.
  • Recommendation only - Enables the Healing Agent to provide recommendations on how to fix UI automation issues on running jobs, but only if permitted by Governance or Orchestrator settings.
  • Same as App/Browser - Inherits the configuration from the parent Use Application/Browser activity.

• Key modifiers - This field enables you to specify the key modifiers you want to use during the drag and drop action. Multiple key modifiers can be selected for the action. The following options are available: None, Alt, Ctrl, Shift, and Win.

• Continue on error - Specifies if the automation should continue even when the activity throws an error. This field only supports Boolean values (True, False). The default value is False. As a result, if the field is blank and an error is thrown, the execution of the project stops. If the value is set to True, the execution of the project continues regardless of any error.

• Enable source offset point - Indicates whether to the offset point is enabled for the source target. When enabled, it takes precedence over the offset point configured on the target.

  • Source anchoring point - Specifies the reference point of the cursor from which the Offset X and Offset Y values are applied. The following options are available: TopLeft, TopRight, BottomLeft, BottomRight, and Center. By default, Center is selected.
  • Source X - Defines the horizontal displacement of the cursor position relative to the selected anchoring point.
  • Source Y - Defines the vertical displacement of the cursor position relative to the selected anchoring point.

• Enable destination offset point - Indicates whether to the offset point is enabled for the destination target. When enabled, it takes precedence over the offset point configured on the target.

  • Destination anchoring point - Specifies the reference point of the cursor from which the Offset X and Offset Y values are applied. The following options are available: TopLeft, TopRight, BottomLeft, BottomRight, and Center. By default, Center is selected.
  • Destination X - Defines the horizontal displacement of the cursor position relative to the selected anchoring point.
  • Destination Y - Defines the vertical displacement of the cursor position relative to the selected anchoring point.

• Delay after - Delay (in seconds) between the time this activity is completed and the time the next activity begins any operations. The default value is 0.3 seconds. Adding a delay between activities ensures that one activity has enough time to complete before the next activity begins.
• Delay before - Delay (in seconds) between the time the previous activity is completed and the time this activity begins performing any operations. The default value is 0.2 seconds. Adding a delay between activities ensures that one activity has enough time to complete before the next activity begins.
• Timeout - Specify the amount of time (in seconds) to wait for the activity to be executed before throwing an error. The default value is 30 seconds.

• Input element - The UI element on which the activity is executed, stored in an UIElement object. This field supports only UIElement objects. This object can be obtained from the Output Element property field of other UI Automation activities.
• Output element - Outputs a target UI Element and stores it in a UIElement object, which can be further used to target the same element with other activities.

• Click Indicate in App/Browser to indicate the UI element to use as target both for Source element and for Destination element.

• Indicate target on screen - Indicate the target again.
• Edit target - Open the selection mode to configure the target.
• Remove informative screenshot - Remove the screenshot of the target application or web page.
• Add to Object Repository - Add the current UI element to a library project, from where it can be reused throughout your automation process.

Properties panel​

• Continue on error - Specifies if the automation should continue even when the activity throws an error. This field only supports Boolean values (True, False). The default value is False. As a result, if the field is blank and an error is thrown, the execution of the project stops. If the value is set to True, the execution of the project continues regardless of any error.
• Delay after - Delay (in seconds) between the time this activity is completed and the time the next activity begins any operations. The default value is 0.3 seconds. Adding a delay between activities ensures that one activity has enough time to complete before the next activity begins.
• Delay before - Delay (in seconds) between the time the previous activity is completed and the time this activity begins performing any operations. The default value is 0.2 seconds. Adding a delay between activities ensures that one activity has enough time to complete before the next activity begins.
• Display name - The name displayed for the activity in the Designer panel. A display name is automatically generated when you indicate a target.
• Timeout - Specify the amount of time (in seconds) to wait for the activity to be executed before throwing an error. The default value is 30 seconds.

• Destination Target - The location where you want to drag and drop the UI Element to. Before indicating on screen the target you want to use, this field is set to (null). Once the target is indicated, all properties regarding the element that was indicated are displayed. The children properties of this field are identical to the ones specific to the Target property.

  • Click offset - Specifies an offset for the click activity, which can be further configured.
    • Anchoring point - Describes the starting point of the cursor to which it offsets from Offset X and Offset Y properties are added. The following options are available: TopLeft, TopRight, BottomLeft, BottomRight, and Center. By default, Center is selected.
    • Offset X - Horizontal displacement of the cursor position according to the option selected in the Anchoring point field. This field supports only Int32 variables.
    • Offset Y - Vertical displacement of the cursor position according to the option selected in the Anchoring point field. This field supports only Int32 variables.
  • Fuzzy selector - The parameters for the fuzzy selector.
  • Native text - The text that is used to identify the UI element.
  • Responsive websites - Enable responsive websites layout.
  • Strict selector - The strict selector generated for the UI element.
  • Targeting methods - The selector types that you want to use for identifying the element. This property can be set to any combination from the drop-down menu:
    • None
    • Strict selector
    • Fuzzy selector
    • Image
    • Native text
  • Visibility check - Checks whether the UI element is visible or not. You can choose one of three options from the drop-down menu:
    • None - Does not check for visibility.
    • Interactive (for Fuzzy Selector) - Default option. Checks if the element is potentially visible, ignoring page scroll and obstructions by other apps, or the fact that the application is minimized. This check is useful when trying to ensure that you are not targeting invisible elements that exist in the DOM but are hidden.
    • Fully visible - Checks if the UI element is visible or not.
  • Wait for page load - Before performing the action, wait for the application to become ready to accept input. You can choose one of three options from the drop-down menu:
    • None - Does not wait for the target to be ready.
    • Interactive - Waits until only a part of the app is loaded.
    • Complete - Waits for the entire app to be loaded.
  • Window selector (Application instance) - The selector that is used for the application window. Only applicable when the window attach mode is set to Application instance.

• Target - The source target element. Target element must be set. Before indicating on screen, this field is set to (null). Once the target is indicated, all properties regarding the element that was indicated are displayed.

  • Click offset - Specifies an offset for the click activity, which can be further configured.
    • Anchoring point - Describes the starting point of the cursor to which it offsets from Offset X and Offset Y properties are added. The following options are available: TopLeft, TopRight, BottomLeft, BottomRight, and Center. By default, Center is selected.
    • Offset X - Horizontal displacement of the cursor position according to the option selected in the Anchoring point field. This field supports only Int32 variables.
    • Offset Y - Vertical displacement of the cursor position according to the option selected in the Anchoring point field. This field supports only Int32 variables.
  • Fuzzy selector - The parameters for the fuzzy selector.
  • Native text - The text that is used to identify the UI element.
  • Responsive websites - Enable responsive websites layout.
  • Strict selector - The strict selector generated for the UI element.
  • Targeting methods - The selector types that you want to use for identifying the element. This property can be set to any combination from the drop-down menu:
    • None
    • Strict selector
    • Fuzzy selector
    • Image
    • Native text
  • Visibility check - Checks whether the UI element is visible or not. You can choose one of three options from the drop-down menu:
    • None - Does not check for visibility.
    • Interactive (for Fuzzy Selector) - Default option. Checks if the element is potentially visible, ignoring page scroll and obstructions by other apps, or the fact that the application is minimized. This check is useful when trying to ensure that you are not targeting invisible elements that exist in the DOM but are hidden.
    • Fully visible - Checks if the UI element is visible or not.
  • Wait for page load - Before performing the action, wait for the application to become ready to accept input. You can choose one of three options from the drop-down menu:
    • None - Does not wait for the target to be ready.
    • Interactive - Waits until only a part of the app is loaded.
    • Complete - Waits for the entire app to be loaded.
  • Window selector (Application instance) - The selector that is used for the application window. Only applicable when the window attach mode is set to Application instance.

• Input element - The UI element on which the activity is executed, stored in an UIElement object. This field supports only UIElement objects. This object can be obtained from the Output Element property field of other UI Automation activities.
• Output element - Outputs a target UI Element and stores it in a UIElement object, which can be further used to target the same element with other activities.

• Private - If selected, the values of variables and arguments are no longer logged at Verbose level. This field supports only Boolean (True, False) values. The default value is False.

• Mouse button - The mouse button you want to use for the drag and drop action. The available options are Left, Right, and Middle.
• Delay between actions - Delay (in seconds) between the actions necessary to perform the drag and drop operation. The default value for this field is 0.3.
• Key modifiers - One or more key modifiers to use in combination with the click.