Monitor Event logs
- Updated: 2024/09/26
Monitor Event logs
Event log gives you a visual summary of all the events occurring during a model interaction session.
There could be multiple events in a session with the ability to see details of a specific event. For example: details of successful connection to foundational models, sending prompts and receiving responses, failed and successful sessions, token usage and other event details. The ability to monitor and view these details enables you to analyze the data and proactively take preventive action for data-security, governance, and compliance.
You can refine your search by available search parameters such as, by Session ID to view all event types specific to the selected session.
Event log table details
The Event log table sorts and displays details as per these columns:
 |
Status: Shows the success or failure of an event. |
 |
Time: Shows the start time of the event. |
 |
Event type: Shows each session type such as: Send prompt, Response received, Model connection, and Trigger prompt template. You can click the Event type link to drill-down and view additional event details. |
 |
Model name: Shows the foundational model version name that was interacted with, such as: Claude for Amazon Bedrock, VertexAI forGoogle Vertex AI, GPT 3.5 Turbo for Azure OpenAI, and others. |
 |
Prompt type: Shows the type of prompt used in the
automation. These are:
|
 |
Automation name: Shows the automation name that used a specific prompt. |
 |
Session ID: Shows the automation session ID. |
 |
Device name: Shows the ID of the device on which the automation was executed. |
 |
User: Shows the ID of the user who ran the automation. |
 |
Folder path: The folder location of the automation from where it was executed. |
Supported event type logs
- Model connection
- Send prompt
- Response received
- Trigger Prompt Template
In the Event type column, click the link to drill-down further to view event details by the following parameters. The details vary as per event type. On the same screen, view different parameters for each event type.
The event details display based on Event type.
Free form logs (generated when using Generative AI Packages) are captured for automations executed with generative AI Packages, and is supported by Model connection, Send prompt, and Response received event types.
Let us go over the supported event type parameters.
- Prompt template: Shows the Prompt Template used when testing the model connection.
- Vendor: Shows the foundational model vendor name, such as Azure OpenAI, Google Vertex AI and others.
- Line number: Shows the line number in the Task Bot where this connection was used.
- Connection method: Shows the connection type used to connect to a model. For example: Amazon Bedrock, Azure OpenAI, and OpenAI connect using API keys. Google Vertex AI connects with a User Account, Service Account or Control room OAuth connection.
- Prompt: Shows the complete prompt-text entered by the user.
- Click More details to view the following
information:
- Vendor: Shows the foundational model vendor name, such as Amazon Bedrock, Google Vertex AI, Azure OpenAI, OpenAI and others.
- Parameters: Shows the parameter values used for the prompt, such as: Max tokens, Top P, Temperature and others. These parameters vary for different models.
- Prompt: Shows the complete prompt-text entered by the user.
- Response: Shows the response received from the model.
- Click More details to view additional information about Tokens consumed: Shows the number of tokens consumed by the model interaction. This helps keep track of tokens consumed and balance.
- Prompt template: Shows the Prompt Template used when testing the model connection.