All Simulations Overview
IMPROVEMENT |
What has changed
A new reporting dashboard for AI Simulations is now available at Insights > AI Simulations. It has four tabs - Overview, Engagement & Performance, Feedback, and Safety Flags - each filterable by date range (Last 7 Days, Last 30 Days, 90 Days, etc).
Overview tab surfaces key metrics across all your simulations at a glance, including:
Simulations Created, Simulation Assignments Created, Simulation Assignments Started, and Simulation Assignments Completed (each with a trend comparison)
Unique Active Learners with a trend comparison
Total Sessions, Sessions Passed, and Average Score (each with a trend comparison)
Average Duration, Allotted Time Used, and Average Attempts Before Passing
Average Feedback Rating from learners
A ranked Simulations table showing sessions, average score, pass rate, and a Performance indicator per simulation (all columns sortable)
Seat utilisation is displayed in the top-right, showing seats taken against total seats purchased, with a prompt to request more seats as limits are approached.
Why you'll love it
Simulation usage has historically lived outside of WorkRamp's reporting tools, making it hard to get a complete picture of learning activity. This view brings simulation data into the same space as the rest of your learning analytics — so admins can identify engagement trends, track pass rates, and surface the simulations that need attention, without switching between systems.
How to use it
Navigate to Reporting > Insights > AI Simulations. A help article with full guidance is available [link to be added].
Performance Health Indicators
NEW FEATURE |
What it is
Each simulation in the reporting view displays a Performance indicator based on its pass rate relative to the configured pass mark. There are three statuses:
Overperforming: pass rate is more than 10 points above the pass mark
On Track: pass rate is within ±10 points of the pass mark
Underperforming: pass rate is more than 10 points below the pass mark
Thresholds are configurable at a global level by admins.
Why you'll love it
At a glance, admins can see which simulations are working well and which may need content changes or additional support. Rather than reviewing raw scores across every simulation, the Performance indicator highlights where action is needed — making it easier to prioritise and report on simulation effectiveness to stakeholders.
How to use it
Performance indicators appear automatically in the Simulations table within the Overview tab, and on the Average Score card within individual simulation reports. To adjust global thresholds, navigate to Settings > [link to be added].
Engagement & Performance (All Simulations)
IMPROVEMENT |
What has changed
The Engagement & Performance tab provides a cross-simulation view of how learners are progressing. It includes:
Three headline metrics: Sessions Passed, Average Score, and Average Attempts Before Passing - each with a trend comparison
A learner leaderboard showing each learner's Average Attempts, Average Score, and Unique Simulations completed - with sortable columns and pagination
An Average Attempts Before Passing chart, comparing the last X days against the previous X days, benchmarked against the passing grade
Why you'll love it
Understanding not just whether learners passed, but how many attempts it took, is a key signal of simulation difficulty and learner readiness. The leaderboard gives admins a quick read on who is most engaged across the full simulation library, and the attempts chart helps identify whether difficulty is trending up or down over time.
How to use it
Navigate to Insights > AI Simulations > Engagement & Performance. A help article with full guidance is available [link to be added].
Feedback (All Simulations)
IMPROVEMENT |
What has changed
The Feedback tab gives an aggregated view of learner feedback across all simulations. It includes:
Average Feedback Rating and Total Responses, each with a 30-day trend comparison
Overall Rating Distribution: a bar chart showing the breakdown of 1–5 star ratings
Top Rated and Lowest Rated simulation tables: showing each simulation's average rating and number of responses
A full Feedback table (Date, User, Simulation, Rating, Comment): sortable by rating
Why you'll love it
Learner feedback is one of the most direct signals of simulation quality. The Top Rated and Lowest Rated tables make it easy to identify which simulations are landing well and which may need a content review, without having to read through every individual comment.
How to use it
Navigate to Insights > AI Simulations > Feedback. A help article with full guidance is available [link to be added].
Safety Flags Reporting (All Simulations)
IMPROVEMENT |
What it is
A dedicated Safety Flags tab provides admins with visibility into flagged interactions across all simulations. The tab includes:
Four headline metrics: Total Flags, Flag Rate, Distress Signals, and User-Reported Flags — each with a 30-day trend comparison
Flags by Categories: a breakdown of flag types including Content Moderation, Dependency, PII Disclosure, User-Reported, and Distress, each expandable to subcategories with individual counts
Flags by Simulation: showing total flags, flag rate, and most-flagged category per simulation, with pagination
Distress Signals: a list of learner sessions where emotional distress was detected, with an expandable conversation excerpt showing the learner's message and the AI's response
User-Reported Flags: a list of interactions manually flagged by learners, including the date, learner, simulation, and reason
All tables support pagination and are filterable by date range.
Why you'll love it
As AI Simulation scales across your organisation, having structured oversight of learner safety signals becomes increasingly important. Safety Flags reporting gives admins the visibility to respond quickly to distress signals, review flagged content for accuracy or appropriateness, and identify patterns across simulations that may warrant a content review.
Learners can raise a flag themselves during a simulation if they encounter a response they want to report, these appear in the User-Reported Flags table for admin review.
How to use it
Navigate to Insights > AI Simulations > Safety Flags. A help article with full guidance is available [link to be added].
Individual Simulation Reports
NEW FEATURE |
What it is
Clicking any simulation name in the Overview tab opens a dedicated deep-dive report scoped to that simulation. This second dashboard has five tabs: Engagement & Performance, Sessions, Success Criteria, Feedback, and Safety Flags.
Engagement & Performance shows metrics for that simulation only:
Total Sessions, Sessions Passed, and Average Score (with Performance indicator badge): each with a 30-day trend comparison
Average Duration, Allotted Time Used, and Average Attempts Before Passing
Score Distribution: a bar chart showing how learner scores are spread across five bands (0–20%, 21–40%, 41–60%, 61–80%, 81–100%)
Average Score Per Attempt: a chart comparing scores per attempt against the previous 30 days, with a passing grade reference line
Why you'll love it
Aggregate scores across all simulations are useful for a health check, but diagnosing why a specific simulation is underperforming requires simulation-level data. Score Distribution shows whether a cohort is clustered just below the pass mark or genuinely struggling, and Average Score Per Attempt reveals whether learners are improving across attempts or plateauing — both signals that inform whether a simulation needs content changes or additional support.
How to use it
Click any simulation name in the Overview tab Simulations table to open its individual report. A help article with full guidance is available [link to be added].
Sessions
NEW FEATURE |
What it is
The Sessions tab within an individual simulation report provides a full view of every learner attempt. It includes:
A banner notification when learners have contested their scores, with a direct link to filter to contested sessions
Attempt Distribution: showing pass rates at each attempt number, with expandable rows listing individual learners per attempt
An All Sessions table showing each learner's score, pass/fail status (including a Contested badge where applicable), attempts before passing, duration, and date, searchable by user and filterable by status
A session detail modal for each learner, showing: attempt number, pass/fail result, duration, date, the end-of-session Summary (conversation summary, things the AI remembered about the learner, and goal results), and the full Transcript with timestamps
Attempt navigation within the modal, so admins can move between a learner's attempts and compare performance over time
Why you'll love it
For the first time, admins can see not just whether a learner passed, but exactly what was said. The transcript view provides full context for score queries, contested results, and coaching conversations. Navigating between attempts makes it easy to identify where a learner is consistently getting stuck, or to verify that a contested score genuinely reflects the conversation.
How to use it
Navigate to the individual simulation report and select the Sessions tab. Expand any attempt row to see learners in that attempt, then click a learner name to open their session detail. A help article with full guidance is available [link to be added].
Success Criteria
NEW FEATURE |
What it is
The Success Criteria tab provides a goal-by-goal breakdown of how learners are performing against the objectives configured for that simulation. It includes:
Passing Requirements: showing how many goals must be met to pass
Sessions Passed and Average Goals Achieved Per Session, each with a 30-day trend comparison
Performance by Goal: a table showing each goal's type (Pass/Fail or Graded), pass rate, sessions passed, and average attempts, with expandable rows showing the Pass Criteria and Fail Criteria text for each goal
Goal Achievement by Learner: a matrix showing each learner's result against every goal, their total goals met, overall pass/fail status, and the attempt number on which they achieved it
Why you'll love it
Aggregate pass rates don't reveal which specific goals are causing difficulty. Success Criteria reporting makes it possible to identify exactly where a cohort is struggling — so content authors can target improvements precisely. The learner matrix makes it easy to spot patterns, such as a goal that almost everyone fails on their first attempt but passes on their second, which may indicate the goal description needs clarifying rather than the content itself changing.
How to use it
Navigate to the individual simulation report and select the Success Criteria tab. A help article with full guidance is available [link to be added].
Feedback & Safety Flags (Individual Simulation)
IMPROVEMENT |
What has changed
The Feedback and Safety Flags tabs within individual simulation reports mirror the all-simulations versions, but scoped to that simulation only.
Feedback includes Average Feedback Rating, Total Responses, Overall Rating Distribution, and a full feedback table with comments — without the Top Rated / Lowest Rated tables (not applicable at single-simulation level).
Safety Flags includes Total Flags, Flag Rate, Distress Signals, and User-Reported Flags headline metrics, Flags by Categories with subcategory expansion, a Distress Signals table with conversation excerpts, and a User-Reported Flags table — all scoped to that simulation.
How to use it
Navigate to the individual simulation report and select Feedback or Safety Flags. A help article with full guidance is available [link to be added].
Chart Sharing and Export
NEW FEATURE |
What it is
Charts and tables within both reporting dashboards can be selected and exported individually or as a set. Export formats include:
PDF (with automatic page breaks after each chart)
PNG
Individual PNGs (.zip)
CSV
Excel
Click Share at the top of any reporting view to open the export toolbar, select the items you want, then choose your format. You can also Copy PNG to paste a chart directly into a presentation or document.
Why you'll love it
Reporting on simulation effectiveness often involves sharing data with stakeholders who don't have direct access to WorkRamp. Export makes it easy to pull key visuals and tables into presentations, documents, or emails — without manual screenshots or reformatting. CSV and Excel exports make it straightforward to do further analysis outside the platform.
How to use it
Click Share in the top bar of any simulation reporting view. Select the charts or tables you want, then choose your export format. A help article with full guidance is available [link to be added].
Bug fixes and small improvements
Enrolment & Access
Re-enrolment now works correctly after a learner has been unenrolled and re-enrolled — simulations are accessible as expected [SIMU-294]
Resolved an error that prevented users from being enrolled in simulations [SIMU-298]
Bulk enrolment status updates are now supported via the API [SIMU-282]
Simulation Authoring
Fixed a blank page that appeared when clicking an environment suggestion during simulation setup [SIMU-265]
Character renames now correctly update across the live simulation [SIMU-280]
Fixed a role-inversion issue where the AI persona was opening conversations in the wrong role [SIMU-301]
AI Character Generator now correctly applies explicit character names provided by the author [SIMU-281]
Copying and editing a character no longer returns a blank page [SIMU-321]
Copying or duplicating a simulation now works correctly [SIMU-329]
Session Experience
Learners now correctly see the Session Summary screen at the end of a simulation, rather than the simulation closing immediately [SIMU-330]
Previous conversations now correctly show only the current enrolment's history, not all past sessions across enrolments [SIMU-305]
Goal and scoring information now displays correctly on the simulation tile in the lobby [SIMU-343]
Collapsing 'Previous Chats' no longer incorrectly expands other navigation sections [SIMU-320]
Reporting
Resolved failures to generate shareable report links [SIMU-206, SIMU-267]
Usage analytics now correctly display Daily Active Users, Total Messages, and Total Tokens [SIMU-333]
Admin
Deleted simulations no longer appear in the simulation selection dropdown on the User Enrolment tab [SIMU-299]
Simulation enrolments now display correctly for Super Admin users [SIMU-310]
Questions? Contact support@learningpool.com