Create and manage Model connections
- Updated: 2024/08/27
Create and manage Model connections
Connect to a curated list of foundational models from hyperscaler vendors such as Amazon Bedrock, Google Vertex AI, Azure OpenAI, OpenAI and others to integrate the power of generative AI into your automations.
The Automation Admin creates and tests Model connections by connecting to foundational models and makes these connections available to the Pro Developers, who would connect to these when creating Prompt Templates. The Model connections are used in Prompt Templates to send prompts and receive responses from the models.
Additionally, the Automation Admin creates custom roles and assigns these Model connections to the custom roles. These custom roles are then assigned to users who would be able to access the Model connections.
Follow these steps to create a Model connection.
Prerequisites
- Role: AAE_Basic, Automation Admin custom role
- Permission: Attended Bot Runner
See Roles and permissions for AI Tools for the Automation Admin custom role permissions.
- If you want to store authentication details in a credential vault, have that information handy. See Secure credential store through Credential Vault.
- To test a Model connection, you must be connected to a Bot Agent (v22.60.10 and above). As part of the test, you would have to run the bot on your desktop. Hence ensure the Bot Agent is configured to your user. For this task, if you have to switch connection to a different Control Room, see: Switch device registration between Control Room instances.
- You would need access to the Recorder package and the Generative AI Prompt Template package to test the connection successfully. A test Prompt would be executed to test the Model connection.
Procedure
Next steps
When you create, test, edit or delete a Model connection, the success or failure details of the actions are captured as logs and can be viewed in , and .
See AI governance.