Create Grounded Model connections with Azure OpenAI RAG capability
- Updated: 2025/02/19
Create Grounded Model connections with Azure OpenAI RAG capability
Create Grounded by AI Search Model connections using the native RAG (Retrieval Augmented Generation) capability from Azure OpenAI to build rich search experiences that combine large language models with enterprise data from Azure AI Search.
You can now integrate an Azure AI Search service with the Azure OpenAI service to create a RAG solution. This allows the LLMs to provide more informed and contextually relevant responses by retrieving information from a your own data.
Prerequisites
- Azure AI Search Service Setup: This involves creating the AI Search service in the Azure OpenAI portal. This includes setting up the service endpoint URL, API keys, and creating the index.
- Data Ingestion and Indexing: Documents are uploaded to a data source, like a blob storage, and then the index is created using the files in the storage. The documents are split into chunks, and the content is vectorized using the embedding model if vector search is enabled.
Prerequisites
The Automation Admin requires these roles and permissions to create and manage Model connections for their business organization.
- Role: AAE_Basic, Automation Admin custom role
- Permission: Attended Bot Runner
- Settings: AI Data Management must be enabled by the Automation Admin and the check box selected for Allow users to disable logs on AI Skills. Allow users with the Bot Creator license to disable data logging when using AI Skills to enable the Data logging toggle in the AI Skills screen.
See Roles and permissions for AI Tools for the Automation Admin custom role permissions.
Other requirements:
- As mentioned earlier, you would first create an Azure AI Search to create a Grounded by AI Search Model connection and use it successfully in an AI Skill.
- If you want to store authentication details in a credential vault, have that information handy. See Secure credential store through Credential Vault.
- To test a Model connection, you must be connected to a Bot Agent 22.60.10 and later. As part of the test, you would have to run the bot on your desktop. Hence ensure the Bot Agent is configured to your user. For this task, if you have to switch connection to a different Control Room, see: Switch device registration between Control Room instances.
- You would need access to the AI Skills package to test the connection successfully. A test Prompt would be executed to test the Model connection.
Procedure
Next steps
Note: When
you create or test an AI Skill in the AI Skill
screen, the success or failure details along with the model responses can be viewed
in these navigation screens:
See AI Governance.