Skip to main content

List Test Cases

coval test-cases list [OPTIONS]
OptionTypeDefaultDescription
--filterstringFilter expression
--test-set-idstringFilter by test set ID
--page-sizenumber50Results per page
--order-bystringSort order
Output columns: ID, INPUT, TYPE, TEST SET, CREATED
# List all test cases
coval test-cases list

# Filter by test set
coval test-cases list --test-set-id ts_abc123

Get Test Case

coval test-cases get <test_case_id>
ArgumentTypeRequiredDescription
test_case_idstringYesThe test case ID
coval test-cases get tc_abc123

Create Test Case

Create a single test case or bulk import from stdin.
coval test-cases create [OPTIONS]
OptionTypeRequiredDescription
--test-set-idstringYesTest set to add the case to
--inputstringNoTest case input text
--expectedstringNoExpected output
--descriptionstringNoTest case description
--stdinflagNoRead test cases from stdin (JSON)
You must provide exactly one of --input or --stdin. They are mutually exclusive — supplying both or neither will result in an error.

Single Test Case

coval test-cases create \
  --test-set-id ts_abc123 \
  --input "I need help with my order" \
  --expected "Order assistance provided" \
  --description "Basic order help request"

Bulk Import from Stdin

Pass --stdin to read one JSON object per line:
echo '{"input_str": "I need a refund", "expected_output_str": "Refund processed", "description": "Refund request"}
{"input_str": "Where is my order?", "expected_output_str": "Order status provided", "description": "Order tracking"}' \
  | coval test-cases create --test-set-id ts_abc123 --stdin
Or import from a file:
cat test_cases.jsonl | coval test-cases create --test-set-id ts_abc123 --stdin
Each line must be valid JSON with the following fields:
FieldTypeRequiredDescription
input_strstringYesInput text
expected_output_strstringNoExpected output
descriptionstringNoDescription

Update Test Case

coval test-cases update <test_case_id> [OPTIONS]
ArgumentTypeRequiredDescription
test_case_idstringYesThe test case ID to update
OptionTypeDescription
--inputstringNew input text
--expectedstringNew expected output
--descriptionstringNew description
coval test-cases update tc_abc123 --input "Updated input text"

Delete Test Case

coval test-cases delete <test_case_id>
ArgumentTypeRequiredDescription
test_case_idstringYesThe test case ID to delete