Skip to main content

AI Recruiter testing guide

General guidance on testing you AI recruiter

Updated over 2 weeks ago

As you are adding content to the vault, you can test your AI Recruiter's knowledge base directly in the CollegeVine platform! Navigate to your AI Recruiter's vault and select Test AI Recruiter (or follow the link below).

Here, you can test chat, email and website recruiter functionalities:

1. Testing via chat

Start chatting with your AI Recruiter to ensure it provides accurate and helpful responses to students. Select Random profile to see how your AI Recruiter personalizes responses for different profiles.

2. Testing via Email

  1. Select Next email to generate a new sample email with the same student profile

  2. Select Random profile to generate a new email based on a new profile

Reminder: The sample student profiles are primarily high school undergraduate applicants. Accordingly, the email content is tailored to their interests, which may not align with the needs of graduate or non-traditional partners. For those partners, please use the test window primarily to review formatting and sample email generation, rather than to expect content that speaks directly to a graduate or non-traditional audience.

3. Testing Website Recruiter

For partners with Website Recruiter, test different prompt questions and interact with the AI Recruiter!

4. Testing via Phone

To test you AI Recruiter's phone capabilities, you will need to navigate to Vault > Comms > Outbound calls or Inbound calls. See example below. Here, you can test the voice, content, transfer paths, and more!

FAQ

  1. What if my AI Recruiter gets something wrong?

    If info needs to be corrected or updated, upload an asset or complete a staff interview to correct the information. Once indexed, your AI Recruiter will have the accurate info.

  2. How will I know if my vault is ready?

    This really depends on each partner and their specific use case. A good way to decide if you’re ready for testing is to reflect on the typical questions you get from prospective students and families, and the information you usually share with them. If that content is already in your vault, you’re in a great place to begin testing.

    And don’t worry — the vault is flexible. We can always add new content as needed, whether it’s to fill gaps or to support different stages of the enrollment funnel that are still being developed.

Automated checks

To ensure the safety and accuracy of your AI Recruiter, we run automated benchmark checks in addition to any testing you complete on the platform. These tests will evaluate your AI Recruiter’s performance across various scenarios, verifying its ability to provide appropriate responses.

After our system completes benchmarking your AI Recruiter, you will receive a report card highlighting your AI Recruiter’s strengths and identifying any areas for improvement.

Did this answer your question?