When a screen is dense, sometimes the AISense Recorder cannot detect and classify the controls correctly. To continue to automate the controls seamlessly, you can use the AISense Recorder to capture coordinates of controls and perform certain actions without having to use the Mouse and Simulate keystrokes packages separately.

Textbox, Radio, Checkbox, and Combobox

Note: Any textbox, radio, checkbox, and combobox controls captured using Define functionality will be coordinate based automation. This functionality is provided for continuity of workflow.
  1. On the left pane, click Automation.
  2. To create a bot, click Create new > Bot or open a bot for which you want to record a task.
  3. Click Start recording.

    The Recorder bot runtime window appears.

  4. Select a window from the drop-down list.

    If you opened an application recently and it is not available in the list, click the Refresh icon.

  5. Click AISense Recorder and allow the scanning process to finish.
    Note: The AISense Recorder downloads the required dependent files the first time you use it on a device.

    The AISense Recorder toolbar appears with these options: Finish, Scan, Define, and Pause.

    The AISense Recorder analyzes the selected application window to identify the UI objects in that window. When the system is analyzing the application window, the options on the toolbar are unavailable. After the analysis completes, the options are enabled and you can start recording the task.

  6. Wait for the AISense Recorder to detect the object.
  7. If the object is not detected automatically, then when the AISense Recorder reaches the Ready state, you can click the Define button to detect the object.
    Note:
    • In the Define window, the AISense Recorder shows embedded help for each control type so you can select the correct control types for custom objects.
    • If you unintentionally click the screen or click before the highlighter appears, AISense Recorder provides visibility into it. You must confirm to capture the object again, or use the Define functionality to define the object on the screen.
    .
  8. Select the specific object type from the list of object types from the Select the object type for the selected area tab.

    The object types that you select is shown under Current selection.

  9. Draw a rectangle around the control that you want to capture.

    The selected area is shown in the box below the Drag and select the area which you want to define from the image field.

  10. Hover the mouse cursor over the text. Once the text is highlighted, select and define the text as the supporting anchor for identification.

    The image of the anchor is shown in the box below the Select one supporting anchor point for the selected area field.

  11. Click Define.
  12. After you have captured the required objects, click Finish.