AI governance dashboard

Track, monitor, and govern the use of generative AI during the creation and execution of automations with a unified view of the aggregated data that is consolidated into a visual representation with AI governance dashboard.

Note: This feature requires the Enterprise Platform license. For information about supported version for this feature, see Enterprise Platform.

Overview

The new AI governance dashboard gives you complete visibility on the following:
  • Top automation executions using AI models:

    Gain a comprehensive understanding of AI usage in your organization's automations, with a focus on risk and compliance reporting. Provide insights on risks tied to the most frequently run AI-powered automations.

  • Most used models from hyperscaler vendors:

    Track and monitor AI models in use to identify non-compliant ones, streamlining risk and compliance management within automations.

  • Token consumption of the most used models:

    Visualize the top token-consuming automations.

AI governance dashboard

The dashboard provides you with analytics to view all model interactions and their use to analyze and derive valuable insights into the use of AI across all your automations. This lets you monitor and enforce compliance of your governing policies for better risk management.
Note: The AI governance dashboard represents data of model interactions during automation executions using the Generative AI and AI Skills Packages.

Drill-down into each automation interaction that uses AI models, during the design or execution phase, to observe the model performance and make an informed decision to validate and promote use of the higher-performing models. Save time and cost by eliminating the use of less efficient models, as per your use case.

The dashboard data also gives you analytics on the model use, performance, and relevant metrics to enable you to optimize forecast cost by monitoring token consumption of the models.

Additionally, you can download reports directly from your dashboard for sharing within your organization as well as for internal compliance audits.

The Automation Command Center (ACC) updates and refreshes data every five minutes. However, the aggregated data takes 15 to 20 minutes for the data roll-up after a complete Control Room refresh.

Note:

The AI governance dashboard is a component of the Automation Command Center (ACC).

To learn about the features of the Automation Command Center (ACC), see Automation Command Center.

Users and permissions

GRC Leads, Automation Leads, and Pro Developers can access the AI governance dashboard via enabled setting in Roles > AI > View AI dashboards permissions. The Automation Admin would enable permissions for the personae.

Enabling the View AI dashboards setting displays the AI governance dashboard. To further drill-down and access detailed logs in the AI prompt log and Event log tabs, you must also enable the following additional settings:
  • AI > View AI prompt logs > View AI prompt details
  • AI > View AI event logs > View AI event details
Note: With the above access and permissions, the Pro Developers can view data for all automations. They are not restricted to viewing data for their automations only. This is a known product behavior.

AI governance dashboard permission

Benefits

Use the AI governance dashboard to take advantage of the following features:
  • Track top automations using AI to understand the extent and use of AI across all automations. This supports effective risk assessment and compliance reporting. Identify and report risks linked to the most frequently executed AI-driven automations for better risk management.
  • Monitor model utilization for the most used models for identifying and tracking non-compliant models that will simplify incident and risk management by timely mitigation.
  • Regulate usage of approved and validated models during the development of automations using AI. Drill-down into each model interaction, AI Skill prompts, and model responses to derive valuable insights for analyzing usage patterns.
  • Visualize token consumption for the top consuming automations for model optimization.
  • Download reports from the dashboard for sharing data and analytics across your enterprise.

Availability

An Enterprise Platform license is required to use the AI governance Analytics dashboard feature.

For details about the Enterprise Platform license, see Enterprise Platform.