Skip to main content

AI Simulations - Reporting

Reporting on AI Simulations in WorkRamp

S
Written by Sam Benson

This article explains where to find AI Simulation data in WorkRamp and what each reporting surface shows. It covers the simulation overview, manager team view, Report Builder, Insights dashboard, and Analytics Studio. It is written for Administrators and Managers.

📌 Note

Reporting for AI Simulations is actively being developed. Further improvements to the reporting experience are coming soon - your Account Manager or Customer Success Executive will keep you updated.

What data does WorkRamp sync?

When a learner completes an AI Simulation, WorkRamp automatically syncs the following data:

Data Point

Description

Status

Not Started, In Progress, Completed, or Failed

Score

Numeric score from the simulation attempt

Completion %

Percentage of the simulation completed

Time Spent

Total time the learner spent in the simulation

Completed At

Timestamp of completion

💡 Tip

AI Simulation statuses map to WorkRamp as follows: Pass and Completed both display as Completed; Fail displays as Failed; Incomplete displays as In Progress; Not Attempted displays as Not Started.

Simulation Overview

Every AI Simulation has its own overview page. This is the primary place for Administrators to monitor a single simulation across all assigned learners.

Summary stats

At the top of the overview page, four headline stats are displayed:

  • Assigned - Total number of learners assigned to this simulation.

  • Overdue - Number of learners who have missed their due date.

  • Completion Rate - Percentage of assigned learners who have completed.

  • Average Grade - Mean score across all completed and failed attempts.

Scores, Goals, Insights and more

Select 'Scores, Goals, Insights and more' from the overview page to open the full AI Simulations analytics view. This provides deeper analysis including individual attempt breakdowns, goal performance, and simulation-specific insights beyond what WorkRamp stores natively.

Assignment table

Below the stats, the assignment table lists every assigned learner with their individual status, progress, grade, due date, completion date, and assigned date. Use the Status and Group filters, search by name or email, or adjust visible columns using 'Columns' to tailor the view.


Manager team view

Managers can view AI Simulation data for their direct reports from My Team in the left-hand navigation of their Learner Home.

Team view

AI Simulations appear as a distinct content type in the team view. For each direct report, managers can see:

  • Completion Rate

  • Average Grade

  • Status — Not Started, In Progress, Completed, or Failed

Team progress is reflected in the stacked bar chart alongside other learning content.

Individual learner view

Selecting a direct report shows their detailed AI Simulation stats including completion rate, average grade, failed count, and overdue count. Drill into a specific simulation to see the learner's status, due date, completion date, grade, and time spent.

Sending reminders

Managers can send email reminders to direct reports who have not started, are in progress, are overdue, or have failed a simulation. Select 'Remind' next to the relevant content. A confirmation is shown after sending.


Report Builder

AI Simulation data is available in Report Builder. Navigate to Reporting > Report Builder and filter by 'AI Simulations' from the Content Type dropdown.

Reports include all standard assignment fields: learner name, content name, status, score, completion date, time spent, and more. Use Report Builder to create custom exports that include AI Simulation data alongside other content types, or in isolation.


Admin Insights - AI Simulations Dashboard

A dedicated AI Simulations analytics dashboard is available at Reporting > Insights > AI Simulations.

A dedicated AI Simulations analytics dashboard is available at Reporting > Insights > AI Simulations.

This dashboard gives a cross-simulation, organisation-wide picture of simulation activity and performance. Click into any individual simulation to access a deeper analytics view scoped to that simulation only.

📌 Note:

This dashboard is accessible to Administrators only. Manager-level reporting is available via My Team, see the Manager team view section above.

Overview tab

The Overview tab surfaces key metrics across all simulations at a glance:

  • Simulations Created, Simulation Assignments Created, Simulation Assignments Started, and Simulation Assignments Completed - each showing change vs the previous period

  • Unique Active Learners

  • Total Sessions, Sessions Passed, Average Score, Average Duration, Allotted Time Used, and Average Attempts Before Passing

  • Average Feedback Rating

  • A Simulations table showing sessions, average score, pass rate, and a Performance indicator (Over performing / On track / Under performing) for each simulation - all columns sortable

💡 Tip:

The Performance indicator shows how a simulation's pass rate compares to its configured pass mark. Overperforming means the cohort is more than 10 points above; Underperforming means more than 10 points below; On Track means within ±10 points.

Engagement & Performance tab

Shows a cross-simulation learner leaderboard with Average Attempts, Average Score, and Unique Simulations completed per learner. Also includes an Average Attempts Before Passing chart comparing the current and previous period against the passing grade.

Feedback tab

Shows aggregated learner feedback across all simulations, including Average Feedback Rating, Total Responses, Overall Rating Distribution, Top Rated and Lowest Rated simulations, and a full feedback table with individual comments.

Safety Flags tab

Shows flagged interactions across all simulations, including:

  • Total Flags, Flag Rate, Distress Signals, and User-Reported Flags

  • Flags by Categories: including Content Moderation, Dependency, PII Disclosure, User-Reported, and Distress, each expandable to subcategories

  • Flags by Simulation: showing which simulations are generating the most flags and what type

  • Distress Signals: sessions where emotional distress was detected, with a conversation excerpt

  • User-Reported Flags: interactions flagged by learners, including their reason

Individual simulation analytics

Click any simulation name in the Simulations table to open a dedicated analytics view for that simulation.

This includes five tabs:

  • Engagement & Performance: simulation-level metrics including Score Distribution and Average Score Per Attempt charts

  • Sessions: a full view of every learner attempt, including scores, pass/fail status, contested scores, and expandable session detail showing the conversation Summary and full Transcript

  • Success Criteria: goal-by-goal performance breakdown, including pass/fail criteria for each goal and a Goal Achievement by Learner matrix

  • Feedback: same as the all-simulations view, scoped to this simulation only

  • Safety Flags: same as the all-simulations view, scoped to this simulation only

💡 Tip:

A blue banner at the top of the individual simulation view will alert you if any learners have contested their scores. Click 'View Sessions' to filter directly to those sessions.

Date range and export

Use the date range selector at the top of the dashboard to filter data by the last 7 days, last 30 days, or a custom range. Click Share to select charts or tables and export them as PDF, PNG, Individual PNGs (.zip), CSV, or Excel.

Analytics Studio

AI Simulation data is also available in Analytics Studio at Reporting > Analytics Studio.

  • AI Simulation results flow into the same content report used for other content types.

  • Filter by Content Type = AI Simulations to isolate simulation data.

  • Combine AI Simulation completion and score data with other WorkRamp data for custom cross-content reports.

📌 Note

Analytics Studio access depends on your WorkRamp plan. Speak to your Account Manager if you do not have access.

FAQs

Why does a learner show as Completed in AI Simulations but Failed in WorkRamp?

AI Simulation statuses map to WorkRamp differently. A Fail in AI Simulations displays as Failed in WorkRamp. A Pass displays as Completed. See the status mapping tip at the top of this article for the full breakdown.

Can I export AI Simulation data?

Yes, in two ways. Use Report Builder to build and export a custom report including AI Simulation data alongside other content types. Or, from the AI Simulations Insights dashboard, click Share to select specific charts or tables and export them as PDF, PNG, Individual PNGs (.zip), CSV, or Excel.

Can managers see individual session summaries?

Managers can see learner scores, status, and progress from the team view. Full individual session summaries - including conversation transcripts, goal breakdowns, and contested score details - are available to Administrators via the individual simulation analytics view. Learners can also email their session summary to their manager directly after completing a simulation.

What does it mean when a learner has contested their score?

At the end of a simulation, learners have the option to contest their score if they feel the result doesn't reflect their performance. When this happens, a banner notification appears at the top of the individual simulation view, and the relevant sessions are marked with a Contested badge in the Sessions tab. Admins can expand any session to review the full conversation transcript and summary to assess the contest. Manual score overrides are not currently available - this is on our roadmap.

Why can't I see the AI Simulations dashboard in Insights?

The AI Simulations dashboard is only visible to Administrators. If you are logged in as a Manager or Learner, you will not see it. If you are an Administrator and the dashboard is not appearing, contact your Customer Success Executive.

What reporting is available for managers?

Managers can view AI Simulation progress and scores for their direct reports via My Team in Learner Home. This includes completion rate, average grade, status, and individual learner drill-downs. Full analytics - including session transcripts, goal performance, and safety flags - are currently available to Administrators only via the Insights dashboard.

Did this answer your question?