Details of using all three actions (Start, Run, and End session) in the UI Agents package for a complete UI Agent.
About this task
Create a new Taskbot and use the actions from the UI Agents package. Three
actions from the package are needed to complete the UI Agent build.
Procedure
Start Session: This should be the first action when building an UI Agent.
This action creates and launches a browser session in which the agent will
run.
-
Select your preferred Model Connection. This requires a
pre-existing model connection in your Control Room. See, Create and manage Model connections.
The following models are supported.
- Amazon Nova Act
- Automation Anywhere Narada
- Open AI GPT-5.4
- Anthropic Claude 4.6 Opus
- Nvidia Nemotron
-
Select the Browser (Chrome or Edge).
-
Optionally, use Show more options > Proxy to launch
the browser session via a proxy.
Note: Users that have installed their browser application
in a custom folder can specify the location of the application under .
-
Provide a unique Session name for the browser where the
UI Agent is running.
Run: Configure the task in this action.
-
Enter your unique Session name from the Start Session
action.
-
Optionally, enter the website that the agent needs to open as the
Starting URL.
-
Enter the agent Goal. Multiple goals can be configured
to run concurrent browsers, using different URLs. See, Guidelines for prompting UI Agents.
-
Optionally, configure Secure variables to obfuscate
sensitive values from the action model.
-
Optionally, specify the datatypes for the output of the agent in
Output format JSON. By default, agent output will be
in string datatype.
-
Enter a Timeout for the Run action. The task is
terminated when the timeout occurs. Adjust this based on complexity of the
task.
-
You must provide the Output file path and name where
the agent will log metadata, action trace, and output (if applicable).
The file must pre-exist and the file-path must be valid. Contents of this file
are overwritten ever time a Run action is executed.
Note: If the file does not exist, the agent will create it. Valid file extensions
are JSON and TXT (example: C:\UIAgentLog.json or C:\UIAgentLog.txt). JSON
is recommended for readability.
-
Optionally, save the context of the output by selecting a variable for
Assign output to variable.
-
Optionally, select the Save Trajectory check box to save
the debug video file.
End Session: Close the UI Agent browser session.
-
Enter the Session name to be closed.