Templates

​

Understanding Templates

Templates help you standardize and streamline your conversation evaluations by pre-configuring test sets, metrics, and simulation parameters. Here’s how to create your first template:

​

Prerequisites

Before creating a template, ensure you have:

1. Created at least one Test Set

2. Defined any custom metrics you need for evaluation

​

Creating a Template

​

Basic Configuration

1. Navigate to the Config -> Templates section

2. Click “Add Template”

3. Provide a descriptive name and description to help identify the template’s purpose

​

Test Set Selection

Choose the conversation scenarios you want to evaluate from your existing Test Sets. These define the actual content and flow of conversations that will be tested.

​

Configure Your Agent Integration

Select how you want to connect your agent:

• Voice: Enter your voice agent’s phone number for voice-based evaluations

• Chat: Available for paid plans with a custom set up - enables evaluation of chat-based interactions. If you need chat integration, let us know.

• None: Choose this option to analyze existing conversation transcripts without running new simulations.

​

Simulated User Configuration

Configure how the simulated user will behave:

• Choose from pre-defined user personas or create your custom user profile

• Customize audio settings:

  • Select from multiple voice options and languages

  • Add background noise profiles

  • Adjust speech patterns and characteristics

​

Metric Selection

1. Choose which metrics to track during evaluation

2. Add both standard and any custom metrics you’ve defined

3. Set target thresholds for each metric if desired

Once you’re done - Save your Template & head over to Launch your first Evaluation!