Run templates save a full evaluation configuration — agent, persona, test set, metrics, and parameters — so you can re-launch identical runs without specifying every option each time.
List Run Templates
coval run-templates list [OPTIONS]
| Option | Type | Default | Description |
|---|
--filter | string | — | Filter expression |
--page-size | number | 50 | Results per page |
--order-by | string | — | Sort order |
# List all templates
coval run-templates list
# JSON output
coval run-templates list --format json
Get Run Template
coval run-templates get <run_template_id>
| Argument | Type | Required | Description |
|---|
run_template_id | string | Yes | The run template ID |
coval run-templates get rt_abc123
Create Run Template
coval run-templates create [OPTIONS]
| Option | Type | Required | Description |
|---|
--name | string | Yes | Display name for the template |
--agent-id | string | No | Agent to evaluate |
--persona-id | string | No | Persona for simulations |
--test-set-id | string | No | Test set to use |
--metric-ids | string | No | Comma-separated metric IDs |
--mutation-ids | string | No | Comma-separated mutation IDs |
--iteration-count | number | No | Number of iterations per test case |
--concurrency | number | No | Max concurrent simulations |
--sub-sample-size | number | No | Number of test cases to sample |
--sub-sample-seed | number | No | Random seed for sampling |
# Create a basic template
coval run-templates create \
--name "Nightly Regression" \
--agent-id ag_abc123 \
--persona-id per_xyz789 \
--test-set-id ts_123456
# Create a template with metrics and concurrency
coval run-templates create \
--name "Full Evaluation" \
--agent-id ag_abc123 \
--persona-id per_xyz789 \
--test-set-id ts_123456 \
--metric-ids "met_001,met_002,met_003" \
--iteration-count 3 \
--concurrency 5
Update Run Template
coval run-templates update <run_template_id> [OPTIONS]
| Argument | Type | Required | Description |
|---|
run_template_id | string | Yes | The run template ID to update |
| Option | Type | Description |
|---|
--name | string | New display name |
--agent-id | string | New agent ID |
--persona-id | string | New persona ID |
--test-set-id | string | New test set ID |
--metric-ids | string | New comma-separated metric IDs |
--mutation-ids | string | New comma-separated mutation IDs |
--iteration-count | number | New iteration count |
--concurrency | number | New concurrency limit |
--sub-sample-size | number | New sample size |
--sub-sample-seed | number | New sample seed |
coval run-templates update rt_abc123 \
--concurrency 10 \
--iteration-count 5
Delete Run Template
coval run-templates delete <run_template_id>
| Argument | Type | Required | Description |
|---|
run_template_id | string | Yes | The run template ID to delete |
Deleting a run template will fail with a 409 error if it has active scheduled runs. Remove or disable associated scheduled runs first.
coval run-templates delete rt_abc123
