When web applications undergo changes or have dynamic UI elements, the bots automating them might not work reliably. The Recorder actions could fail because they might not find the UI elements at runtime. With the new Generative Recorder fallback mechanism, you can automate such dynamic web pages more reliably.

Note: Generative AI models can produce errors and/or misrepresent the information they generate. It is advisable to verify the accuracy, reliability, and completeness of the content generated by the AI model.

See also Generative Recorder Product Club.

Architecture

The Generative Recorder architecture diagram illustrates the system's framework, highlighting the integration of generative AI for resilient UI automation.

Generative Recorder architecture

Data flow

The Generative Recorder flow diagram outlines the sequence of operations, showcasing how generative AI is employed to detect and adapt to interface changes, ensuring continuous and resilient automation.

Generative Recorder flow diagram

Availability

An Automator AI Platorm Base license is required to enable the Generative Recorder capability. A license is available to all Cloud regions. When the license is assigned, the Generative Recorder capability will be available to all users with the following roles and device license:
  • Role: AAE_Basic and AAE_Bot Developer
  • Device License: Bot Creator or Citizen Developer
Note:
  • This feature is available with AWS and GCP Cloud.
  • Ensure that the minimum Bot Agent version and the Control Room version on your system is the version that was released with Automation 360 v.32.
  • This feature is currently supported only for HTML technology in Google Chrome and Microsoft Edge browsers.
  • Ensure that you use Bot compatibility version 6 to leverage Generative AI and Native fallbacks for enhanced automation resiliency. If you set your Bot compatibility version to 5, use any of the following conditions in your automation, and run it in Debug mode, you might encounter issues while updating the DOMXPath value to the recommended fallback value during bot run whenever a successful fallback occurs:

    Recorder conditions such as Object exists and Object does not exist in If, Else if, Wait for condition, and Loop while actions.

Supportability

Recorder Native and Generative AI-based fallback also supports the Object exists and Object does not exist conditions in the following actions:
  • If action
  • Loop > While action
  • Wait > Wait for condition action
Note:
  • When you select the Advanced time out > Stop the bot and display an error message option, the bot will not display an error message.
  • This capability is supported for Google Chrome and Microsoft Edge browsers.
  • Generative Recorder supports resiliency when there is an anchor UI element to fall back on, and when that UI element label appears only one time on the page.

Benefits of generative AI

  • Fallback: When Recorder is not able to automate a web UI element, leverage generative AI and native fallbacks to get the latest UI element details and automate.
  • Secure: The data specific to the UI element is used only after redaction and anonymization. Business application data that is not related to the automated UI element is not used.
  • Validate: Process generative AI response through another layer of validation to help improve fallback accuracy.
  • Optional: If you do not want to use the fallback option, you can opt out.
  • Traceable: Citizen developer, Professional developers, and Automation admins will be notified on the successful use of the generative AI fallback.

Benefits of Generative Recorder

Resources