Key Concepts
Test Sets
Key Concepts
Test Sets
Create test sets.
A Test Set is a structured collection of test cases designed to evaluate specific functionalities, workflows, or scenarios in a project.
To define a test set you need to specify the following attributes:
-
Test Set Name
-
Test Set Owner
-
Test Set Description
-
Type of Test Set:
| Field Description | Description | Example Test Case |
|---|---|---|
| Scenario | Natural language descriptions of user intents and goals. | Call my agent to order a pizza |
| Transcript | Conversation history between user and assistant to resimulate. | [{“role”: “assistant”, “content”: “Welcome to X Restaurant. How may I assist you today?”}, {“role”: “user”, “content”: “I would like to order some pizza.”}] |
| Workflow | Graph showing the workflow you would like to test. | Greeting the customer -> Ask for Pizza -> Confirm request |
| Stream | Audio stream | - |
| Default | Generic test set type. | Default value. |
Each test case consist of:
-
Input: Has the same format as the defined test set (see examples in the table above)
-
Expected Output (Optional): Specify an expected test output if wished.
Add a Test Case
See API documentation for more details here
Was this page helpful?