List Runs
coval runs list [OPTIONS]
| Option | Type | Default | Description |
|---|
--filter | string | — | Filter expression (e.g., status="COMPLETED") |
--page-size | number | 50 | Results per page |
--order-by | string | — | Sort order (e.g., -create_time) |
# List all runs
coval runs list
# Filter completed runs
coval runs list --filter 'status="COMPLETED"'
Get Run
| Argument | Type | Required | Description |
|---|
run_id | string | Yes | The run ID |
coval runs get run_abc123
Launch Run
coval runs launch [OPTIONS]
| Option | Type | Required | Description |
|---|
--agent-id | string | Yes | Agent ID to evaluate |
--persona-id | string | Yes | Persona ID for simulated caller |
--test-set-id | string | Yes | Test set ID containing test cases |
--iterations | number | No | Iterations per test case (default: 1) |
--concurrency | number | No | Parallel simulations |
--name | string | No | Display name for the run |
--mutation-id | string | No | Single mutation ID to test |
--mutation-ids | string | No | Comma-separated mutation IDs |
# Basic run
coval runs launch \
--agent-id ag_abc123 \
--persona-id per_xyz789 \
--test-set-id ts_123456
# Run with options
coval runs launch \
--agent-id ag_abc123 \
--persona-id per_xyz789 \
--test-set-id ts_123456 \
--iterations 3 \
--concurrency 5 \
--name "Regression Test"
# Run with mutations
coval runs launch \
--agent-id ag_abc123 \
--persona-id per_xyz789 \
--test-set-id ts_123456 \
--mutation-ids "mut_001,mut_002,mut_003"
Watch Run
Monitor a run’s progress in real time with a live progress bar.
coval runs watch <run_id> [OPTIONS]
| Argument | Type | Required | Description |
|---|
run_id | string | Yes | The run ID to watch |
| Option | Type | Default | Description |
|---|
--interval | number | 2 | Poll interval in seconds |
# Watch with default interval
coval runs watch run_abc123
# Watch with faster polling
coval runs watch run_abc123 --interval 1
Delete Run
coval runs delete <run_id>
| Argument | Type | Required | Description |
|---|
run_id | string | Yes | The run ID to delete |
Run Statuses
| Status | Description |
|---|
PENDING | Run is created but not yet started |
IN_QUEUE | Run is queued for execution |
IN_PROGRESS | Simulations are actively running |
COMPLETED | All simulations finished successfully |
FAILED | Run encountered an error |
CANCELLED | Run was cancelled |
DELETED | Run was deleted |
When using --filter, use the underscore-separated enum values (e.g., status="IN_PROGRESS").
