What to test
Test the agent with messages that represent real customer situations:- the happy path the agent should handle
- messages that should escalate
- ambiguous customer requests
- missing order or customer data
- sensitive actions that require approval
- messages that should not trigger the agent
Test ownership and hand-offs
Use a short ticket conversation for each case:
Also test a later customer message after a human hand-off. It may be matched to an eligible AI Agent again. If the ticket must stay human-only, test after narrowing or disabling matching AI Agent triggers, stopping Classic AI auto-reply, and narrowing or disabling macro Workflows with AI prompts.
Create useful test cases
1
Start from real tickets
Use real customer wording when possible. Short synthetic prompts often miss the details that
make support cases hard.
2
Add expected behavior
Define what the agent should do: answer, ask a follow-up, use an action, request approval, or
escalate.
3
Include negative cases
Add examples where the agent should not act.
4
Review action usage
Check that the agent uses only the actions needed for the case.
5
Retest after changes
Rerun the relevant cases after changing instructions, triggers, skills, actions, or approvals.
Use run history
Use it to check:- why this agent received the ticket
- which instructions and skills influenced the run
- which actions the agent used
- whether approval was requested
- what customer-facing reply was produced
- why the agent escalated or stopped
Debug unexpected behavior
If a run did not behave as expected, check:- whether another automation already owned the conversation
- whether an exact or meaning-based trigger selected a different agent
- whether the agent instructions were too broad
- whether a skill contained conflicting guidance
- whether the needed action was enabled
- whether approval blocked the final step
- whether the ticket lacked required customer or order context
Best practices
- Test before activation and after every major instruction or action change.
- Keep approval on while you review early production runs.
- Add a negative test whenever the agent overreaches.
- Use run history to improve instructions, not just to debug failures.