Test and launch your custom agent so it can give safe, accurate answers to your workforce. A structured testing phase helps you check how the agent responds before you roll it out more broadly. A successful rollout gives your subject matter experts more time while employees get help right away.
Select your pilot testers
Start with a small group of trusted subject matter experts before you share the agent more widely. These users understand your company policies and can spot wrong answers or missing information. Ask them to set aside time to test the agent as part of their daily work.
Create and assign your test groups
Set up a private area to test the agent before anyone else can see it. The setup depends on which platform you use.
Start by creating temporary testing groups for your custom agents:
- For agents in the ClearCo app, create a security group.
- For agents in the LMS, create a test learning group.
From Agent Studio, assign the agent to your test group. If testing a ClearCo custom agent, select Knowledge Contexts and confirm your uploaded files are Published.
WARNING
If you assign a custom LMS agent to a user who does not have access to the connected learning objects, the system automatically disables material to protect your data.
Provide a list of what to check
Give your pilot testers clear instructions on what to test so they can confirm your safety rules work. Ask them to check that:
- The agent refuses to answer questions outside the scope of your company documents.
- The agent tells the user to contact a human expert for sensitive information, such as penalty fees or password resets.
- The response tone fits your company style.
- The source links in the text match the correct documents.
- For LMS custom agents: they are able to answer all topic-related questions.
Report findings
Gather feedback from your trusted experts to find content gaps and confirm the experience works as expected.
- Ask your pilot team to report wrong answers, missing links, or confusing tone.
- Review their feedback to see where the agent struggled.
- Update your uploaded files or course materials to fix any gaps they find.
Comments
Please sign in to leave a comment.