Configure AI Evaluations to start tracking and improving strategy.

Evaluations can be created for AI skills and used to track the success and progress of the skill.

Procedure

  1. From the AI Skill page, select Create evaluation.
  2. Name the evaluation.
  3. Optionally, add a Description.
  4. Select models for the evaluation.
    1. Use the Selected model connection only to use the existing model configured in the AI Skill.
    2. Select Compare multiple model connections to apply alternative models for the evaluation.
  5. Upload a dataset to define the metrics for the output of the skill to be measured against. The file should be in CSV format with a maximum size of 100 kb.
  6. Click Create skill evaluation.
    The evaluation is saved and the results are displayed under the Evaluation tab, at the bottom of the AI skill. A notification is sent to you when the evaluation is ready.