Skip to navigation
Testing

Test suite

The Test suite lets you save real conversations as test cases and re-run them against Draft or Sandbox to check for behavioral drift. Each case captures the full conversation — user messages, agent replies, and tool calls — so you can verify the agent still handles the scenario correctly after changes.

Create a test case from a conversation

1

Open a conversation in Conversation Review

Go to Analytics > Conversations and select a conversation. In the side panel, click the Add test button.

Add test from Conversation Review

2

Name the test case

In the Create test case modal, give the case a descriptive name (for example, “Sunday Opening Test”) and click Create.

Create test case modal

3

Review the test case

The test case opens with the full conversation transcript. Edit assertions and user input to define what counts as a successful run.

Test case view

Edit test case parameters

Each test case stores the function call values from the original conversation. You can edit these to test variations of the same scenario without creating a new case.

  1. Open the test case from Test suite.
  2. Select the parameters you want to modify.
  3. Adjust values to simulate a different scenario — for example, change a date, customer ID, or location.
  4. Save the case.

Editing parameters is useful for testing edge cases. For example, duplicate a booking test case and change the party size to test large-group handling.

Best practices

  • Save tests from real conversations — cases from Conversation Review capture real-world scenarios your agent has already encountered.
  • Name cases descriptively — use names that describe the scenario, not the expected outcome (for example, “Sunday Opening Test” rather than “Test 1”).
  • Cover edge cases — duplicate a case and tweak parameters to test boundary conditions without re-recording a conversation.