Image Recognition package

The Image Recognition package contains actions that enable you to search for a user interface (UI) element in an application based on an image to automate a task in that application.

Actions in the Image Recognition package

Use these actions to automate a task when it is not possible to capture UI elements of applications that are:
  • Exposed over Citrix
  • Accessed using the Remote Desktop Protocol (RDP)
  • Developed using legacy technology

Image recognition is also useful when object-based recognition does not work or is unreliable. For example, you can use an image to search for the Close button in an application and perform a left-click operation.

The Image Recognition package contains the following actions:

Action Description
Find image in window See Using Find image in window action.
Find window in window See Using the Find window in window action.

Secure recording

When secure recording mode is enabled, bots do not display the target object images after capture. This ensures that sensitive data is not shown.
Note: Although the bots do not display the target images after capture, the images are still stored in the Control Room because they are required to run the bots.

When you record a task in secure recording mode, the Preview window temporarily shows an image of the captured area. This image is hidden after you navigate away from the Bot editor window or refresh it.

For new automations, when you capture objects in secure recording mode, you can choose to automatically delete the values of the unused object properties by enabling the Automatically delete unused object properties on save option. When you enable this option, the values of the object properties that are not a part of the search criteria will be discarded when you save the automation and refresh it. This ensures that personally identifiable information (PII) is not accidentally stored in the automation. For more information on how to enable the secure recording settings, see Secure recording.
Note: If you are using Generative Recorder to automate your tasks, and you have enabled the Automatically delete unused object properties on save option, then the Generative AI fallback is not supported.
Note:
  • This capability is supported with Recorder package (version 3.2.1-20240606-105427 and later) and Bot Agent (version 22.60.23 and later).
  • If you want to use this option in your existing automation, you must recapture the controls.
  • The value of the Left, right, height, and width properties will not be discarded.

A user with admin privileges must enable this setting. See Configure Settings.