Understanding the Overview Analysis Tab on the AI Coaching Dashboard

This section focuses on engagement metrics and session duration.

Participation Metrics

Active Learners

• The total number of users who submitted at least one roleplay attempt during the selected time period
• The percentage below shows the change compared to the previous period (e.g., "+10% vs last quarter")

Avg Attempts

• The average number of roleplay submissions per learner during the selected time period
• Shows how frequently your team is practicing

Training Hours Saved

• The total time saved by using AI coaching instead of traditional in-person or live roleplays
• SmartWinnr calculates this by comparing the average AI roleplay duration to a traditional 30-minute roleplay session
• Example: If an AI roleplay takes 8 minutes, that's 22 minutes saved per attempt

Avg Session

• The average time a learner spends completing one AI roleplay attempt
• Helps you understand typical session length and engagement
• The percentage shows how this compares to previous periods

Score Over Attempts

This chart tracks how learners improve their performance as they complete more practice attempts.

What it shows:

• The average score (0-100 scale) for all learners across their 1st, 2nd, 3rd, 4th, and 5th attempts
• Each point on the line represents the group average for that attempt number
• The upward trend line demonstrates that practice leads to improvement

How to read it:

• The x-axis shows attempt numbers (Attempt 1, Attempt 2, etc.)
• The y-axis shows the average score (0-100 scale)
• The blue shaded area under the line emphasizes the progression
• Each data point represents the average score for all learners on that specific attempt number

What this tells you:

• An upward trend confirms that repeated practice is working
• Steeper slopes between attempts indicate rapid improvement
• Flatter sections suggest learners may be reaching a plateau and might need additional resources
• The biggest improvement typically occurs between Attempt 1 and Attempt 2

Why this matters: This chart validates that your coaching program is effective. Learners should improve with each attempt. If the line is flat or declining, it may indicate that the roleplay scenarios are too difficult, feedback isn't clear enough, or learners need additional coaching support.

Action items:

• If you see consistent upward trends, your program is working well
• If the line flattens after 2-3 attempts, consider whether learners need more attempts to reach proficiency
• If scores decline, investigate whether technical issues or unclear scenarios are causing problems

Skill Performance Improvement

This section shows which specific skills are improving most effectively through practice.

What it shows: A horizontal bar chart displaying the percentage improvement for each skill from a learner's first attempt to their most recent attempt.

How to read it:

• Each bar represents a different skill (e.g., Trust Building, Probing, Engagement, Communicating Skills)
• The length of the bar shows the improvement percentage
• The percentage is displayed at the end of each bar (e.g., 8.9%, 7.4%, 12.4%)
• Longer bars indicate skills with greater improvement rates

Skills displayed:

• Trust Building: Improvement in building rapport and credibility with customers
• Probing: Improvement in asking effective questions to uncover customer needs
• Engagement: Improvement in keeping customers interested and involved in the conversation
• Communicating Skills: Improvement in overall communication effectiveness

What the percentages mean: If "Communicating Skills" shows 12.4%, this means that on average, learners improved their communicating skills scores by 12.4% from their first attempt to their most recent attempt.

Why this matters: This helps you identify which skills are developing well and which might need additional focus. Skills with lower improvement percentages may need:

• More practice opportunities
• Better training resources
• Clearer evaluation criteria
• Additional coaching support

Using the All Skill Groups dropdown:

1. Click the "All Skill Groups" dropdown in the upper right of this section
2. Select a specific skill to filter the view
3. The chart will update to show only that skill's performance

Performance Trends

This section provides auto-generated narrative insights about overall performance patterns.

What it includes: A text summary highlighting key trends in quarter-over-quarter performance, program effectiveness, and skill development patterns.

Example insights:

• "Quarter-over-quarter performance improvement of 28% demonstrates program effectiveness"
• "Sustained quarterly gains across multiple training dimensions"
• "Holistic development approach proving consistently effective"

Key details:

• All content is auto-generated by SmartWinnr AI
• Updates automatically as new performance data is collected
• Provides high-level context for the metrics and charts you're viewing

Why this matters: These narrative insights help you quickly understand the big picture without having to analyze all the individual metrics. Share these summaries with leadership or stakeholders to demonstrate program impact.

Skills Development

This section displays current skill levels compared to your target proficiency goals.

What it shows: A radar chart (also called a spider chart) that compares your team's current performance against predefined target levels across multiple skills.

How to read it:

• Center of the chart: Represents 0% proficiency
• Outer edge: Represents 100% proficiency
• Blue filled area (Current Level): Shows the average current proficiency across all learners for each skill
• Orange dotted line (Target Level): Shows the benchmark your organization has set for proficiency

Skills displayed: The chart typically shows multiple skills around the perimeter, such as:

• Opening (starting conversations effectively)
• Closing (concluding and gaining commitment)
• Probing (asking questions)
• Presenting (delivering information)
• Objection (handling objections)

What this tells you:

• Skills where the blue area reaches or exceeds the orange line are meeting or exceeding targets
• Skills where there's a gap between blue and orange need more practice or coaching attention
• The overall shape shows your team's skill balance (a more rounded shape indicates balanced development)

Using the All Skill Groups dropdown:

1. Click the "All Skill Groups" dropdown above the chart
2. Select a specific skill (e.g., "Probing" or "Engagement")
3. The chart updates to show detailed performance for only that skill

Target levels:

• Default target levels are set to 80% proficiency
• These can be customized during initial project setup to match your organization's standards
• Different skills may have different target levels depending on your priorities

Why this matters: This visual comparison makes it easy to spot skill gaps at a glance. Use it to prioritize which skills need immediate attention and which are already performing well.

Key Focus Areas

This section highlights strategic priorities based on your team's current performance data.

What it includes: Narrative recommendations for where to focus your coaching efforts, including:

• Quarterly priorities for skill transformation
• Multi-faceted development initiatives
• Strategic training goals based on performance gaps

Example focus areas:

• "Quarterly focus: Comprehensive skill transformation program"
• "Multi-faceted development initiative will address competency gaps and drive performance improvements"

Key details:

• Auto-generated by SmartWinnr AI based on current data
• Updates dynamically as performance patterns change
• Tailored to your organization's specific needs and gaps

Why this matters: These recommendations help you move from data to action. Instead of guessing where to focus, you get AI-driven guidance on which areas will deliver the most impact.

AI Insights

The AI Insights panel provides intelligent, data-driven observations about learning patterns and opportunities.

What it includes: Two types of auto-generated insights:

1. Pattern Recognition: Insights about long-term learning behaviors and optimization opportunities

2. Predictive Capabilities: Forecasts about skill development outcomes and training effectiveness

Key details:

• These insights are generated automatically by SmartWinnr AI
• No manual configuration or intervention is required
• Insights are based on patterns across all learners and all attempts

Why this matters: AI insights can uncover trends and opportunities that aren't visible in the raw data alone. The predictive capabilities help you:

• Identify learners who may struggle before they fall behind
• Adjust training programs proactively rather than reactively

What happens next

After reviewing the Overview Analysis tab:

Immediate actions:

• Identify skills with the lowest improvement rates and create additional training materials
• Follow up with groups or individuals showing low participation
• Celebrate and recognize teams showing strong improvement trends

Strategic planning:

• Use the Key Focus Areas recommendations to plan your next quarter's training initiatives
• Adjust target levels if they're too easy or too difficult for your current team
• Share Training Hours Saved metrics with leadership to demonstrate ROI

Ongoing monitoring:

• Check the Score Over Attempts chart weekly to ensure improvement continues
• Monitor the AI Insights for early warning signs of issues
• Track whether your interventions are moving the Skills Development radar chart toward target levels

The dashboard updates automatically as learners submit new attempts, so you always have access to the most current data.

Tips and best practices

For participation metrics:

• Review Active Learners and Avg Attempts weekly to catch engagement issues early
• If Avg Attempts is below 3, encourage learners to practice more for better results
• Use Training Hours Saved to demonstrate program value to stakeholders

For score tracking:

• Look for the steepest improvement between Attempt 1 and Attempt 2
• If learners plateau after 3 attempts, consider whether they need more challenging scenarios
• Compare your Score Over Attempts trend to previous time periods to ensure consistent improvement

For skill development:

• Focus on skills showing the lowest improvement rates first
• Use the Skills Development radar chart in team meetings to visualize progress
• Celebrate when skills reach or exceed target levels

For AI insights:

• Take predictive insights seriously—they're based on patterns across thousands of attempts
• If AI suggests optimization opportunities, investigate and test recommended changes
• Share relevant insights with individual learners to help them understand their own patterns

For strategic planning:

• Align your training calendar with the Key Focus Areas recommendations
• Review Performance Trends monthly to track long-term effectiveness
• Use the data from this tab to justify budget requests or program expansions

Things to know

About the metrics:

• Active Learners only includes users with at least one attempt during the selected time period
• All percentages showing "vs last quarter" compare to the immediately previous time period of equal length
• Training Hours Saved assumes a 30-minute traditional roleplay as the baseline

About the charts:

• Score Over Attempts uses a 0-100 scale for all skills
• All improvement percentages in Skill Performance Improvement represent change from first to most recent attempt
• The Skills Development radar chart's target levels default to 80% but can be customized

About AI-generated content:

• Performance Trends, Key Focus Areas, and AI Insights are all auto-generated
• All AI-generated content updates automatically as new data becomes available
• No manual configuration is needed for these insights

About time filters:

• All metrics and charts on this tab reflect only the selected time period
• Changing the date range will update every section simultaneously
• Compare 30-day and 90-day views to see both short-term and long-term patterns

About skill groupings:

• The "All Skill Groups" dropdown lets you filter views to specific skills
• This affects both the Skill Performance Improvement chart and the Skills Development radar chart
• Select "All Skill Groups" to return to the complete view