Skip to content
  • There are no suggestions because the search field is empty.

AI Evaluations (Coming Soon)

Sessionboard’s AI Evaluations feature automates and enhances the submission review process using AI-generated scores, summaries, and feedback via customizable Virtual Evaluator Personas.

 

Contact support@sessionboard.com to have AI Evaluations enabled within your event. 

 


 

Overivew

You can now access Evaluations through the new ‘Evaluation’ module.

Screenshot 2025-05-09 at 10.27.14 AM

AI Evaluations is Sessionboard’s first AI-powered tool designed to automate and enhance the speaker submission review process. Admins can create evaluation plans using AI personas that reflect their team’s preferences, rubrics, and content criteria. The system generates scores and summaries instantly, provides insight-rich feedback, and displays everything in a real-time dashboard—empowering organizers to make faster, more consistent, and more confident programming decisions. Eval Results-1 - Scores

 

  • 🚀 Accelerate speaker selection with AI-generated feedback and scoring
  • 💡 Improve evaluation consistency with customizable reviewer personas
  • 🔒 Save hours of manual work without sacrificing content quality

 

Enhance AI-Powered Evaluation with Complete Event Details

With Sessionboard’s new AI features, the more context you provide about your event, the more effective the AI will be in supporting your setup, especially when generating evaluator personas for session reviews.

Be sure to complete the following fields within the Settings module on the Event Details page:

  • Event Type

  • Event Website URL

  • Event Location

  • Theme

Screenshot 2025-05-09 at 10.22.56 AM

 

These fields help the AI better understand the nature, audience, and goals of your event, leading to smarter persona suggestions and more tailored evaluation workflows. Taking a few extra minutes here allows the AI to deliver more meaningful support as you build out your review process.

 

Evaluator Personas

What Are Personas?

Personas are AI-powered virtual evaluators designed to review your sessions from a variety of perspectives. Each persona is tailored to reflect a specific role, audience type, or area of expertise—such as a technical expert, first-time attendee, or executive decision-maker.

By using these personas, you can gather comparative feedback that reflects diverse viewpoints, helping you assess content quality, relevance, and impact more thoroughly. This feature streamlines your evaluation process while providing deeper insights into how your sessions resonate across different audiences.

Create A Persona

You can create as many Personas as you'd like. Personas can not be imported/bulk created at this time. 

Feel free to use the 3 default personas available to you (NOTE: These can not be edited).

image (6)-1

 

From the left-hand menu, click on Evaluation, then select the Personas tab.

Screenshot 2025-05-09 at 10.36.55 AM

In the top right corner of the Personas section, click the orange “Add Persona” button.

Screenshot 2025-05-09 at 10.37.48 AM

Within the pop-up model, complete the following fields:
  1. (required) Name: Enter the persona’s name (e.g., Jordan Lorem).
  2. (required) Role: Define their professional role or perspective (e.g., Thought Leader).
  3. (required) Biography: Add a short description of the persona’s background and expertise to help contextualize their feedback.
  4. (required) Select a Feedback Style: Choose one of the available styles to guide how this persona provides evaluations:
    1. Positive
    2. Neutral
    3. Constructive
  5. (required) Define Preferences:
    1. Likes (3): Enter up to three types of content or qualities this persona prefers (e.g., “Engaging storytelling,” “Data-backed insights”).

    2. Dislikes (3): Enter up to three types of content or issues the persona tends to critique (e.g., “Generic content,” “Overly technical jargon”).

Once complete, click the orange 'Save Persona' button at the bottom to add it to your custom personas list.

Screenshot 2025-05-09 at 10.35.16 AM

 

These custom personas can now be assigned to evaluate sessions, providing AI-generated feedback aligned with the traits you defined.

 

How To Create An Evaluation Plan Using Personas

Within the Evaluations module, select the tab Evalution Plans and click the orange 'Add Plan' button on the top right-hand corner of your screen.

Screenshot 2025-05-14 at 1.54.29 PM

Within the Evaluation Plan builder, follow the steps below:

1. Type

Select your evaluation type - Virtual Evaluators

Screenshot 2025-05-14 at 1.55.22 PM

 

2. Configuration

On this page, you will define the basic settings for your evaluation plan. These settings help guide your evaluators through the review process:

  • Name: Enter a clear and descriptive title for your evaluation plan.
  • Instructions: Provide detailed instructions or guidelines that evaluators should follow when reviewing submissions. Use this section to outline criteria, scoring expectations, or any other relevant notes.
  • Include Uploaded Files: Toggle this option on if you want evaluators to view and access any files uploaded to sessions.
3. Evaluators Select the personas (custom or default) you would like to use to help evaluate your submissions.
4. Session Filters

Filter your evaluation plan by levels, languages, tracks, tags, format, and status to assign specific submissions to your plan.

NOTE: You CAN NOT filter by custom fields. 
    5. Display Fields

    Please select the session, speaker, and evaluation fields that should be visible to personas within the evaluation plan. These fields will be used to guide their review and generate relevant feedback.

    6. Grading Options Rating Icon: Select the icon you would like to use to gather feedback from your evaluators.
    • Faces & Number Icons: 1-5

    • Star & Heart Icons: 1-20

    Enable Rubric: Rubrics allow your personas to rate the submission using the criteria you have created within the Rubric. Each criterion is weighted to provide you with an average cumulative score.

    NOTE: The character count for each criterion may not exceed 255 characters. The sum of the criteria must equal 100%

    Once complete, select the orange 'Generate Reviews' button at the bottom of page 6 (Grading Options).

    Screenshot 2025-05-09 at 1.32.50 PM

    A pop-up will appear allowing you to proceed with generating reviews or cancel and generate at a later date.  Screenshot 2025-05-09 at 1.26.36 PM

     

    To generate a review at a later date, select the ellipses with the 'Actions' column and click 'Generate Evaluations'.

    Screenshot 2025-05-09 at 1.29.53 PM

     

     

    View Evaluation Results

    Evaluation plans that use Virtual Evaluators (i.e. AI Evaluators) are identifiable with a blue icon to the left of the plan name.

    Screenshot 2025-05-09 at 1.34.14 PM

    Select the ellipses within the Actions column to either:

    Screenshot 2025-05-14 at 2.03.05 PM

    • Review: Preview session ratings/feedback
    Screenshot 2025-05-14 at 1.59.45 PM
    • Export Evaluation Plans: Event admins can export detailed information from graded evaluation plans.

    Choose which version you want to export:

    • Individual Grades Report - This provides a breakdown of session grading by the evaluator, including their comments and criteria rankings with weighted scores
    • Cumulative Grades Report - This provides a summarized view of grades per session, including data from the session submission and session owner information.

     

    Frequently Asked Questions

    • How is my data protected?
      • Sessionboard uses a closed AI processing model, which means your data is sent through private, secured API channels. All communications with AI models are encrypted in transit (TLS 1.2+), and strict access controls are in place to protect your data.
    • How can I train the system to be more personalized?
      • The best approach is to ensure your event and plan are enriched with information such as Event Theme, Website URL, and Plan Instructions. Write these like you would when explaining your event to new team members or evaluators.

        Note: we are not storing your data or using it to train our model. It’s only accessible within your event and organization.
    • What if I don't like the results? Can I try again?
      • Yes! You can do the following:
        • Regenerate evaluations
          Screenshot 2025-05-09 at 1.24.20 PM
        • Duplicate plans and use new instructions
        • Create new plans with different combinations of evaluators.

        There is no limit to the number of plans/virtual personas/generations you can create, although we recommend using session filters to create relevant groups of data to be evaluated. This will speed up the processing time and ensure your results are delivered faster.
    • Who can I contact if I want more information?